00000001:02000400:0.0F:1790778645.534094:0:3094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1790778662.328357:0:3317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1790778664.877364:0:3377:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 463 MB/s 00000001:01000000:2.0F:1790778665.127819:0:3377:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 605 MB/s 00000001:01000000:3.0F:1790778665.379133:0:3377:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3904 MB/s 00000020:02000000:3.0:1790778666.264975:0:3408:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_g696972c 00000400:02000000:0.0:1790778667.290631:0:3423:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.102@tcp [8/256/0/180] 00008000:02000000:0.0:1790778671.697404:0:3573:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1790778724.951844:0:5176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790778739.329016:0:5925:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790778739.329023:0:5925:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790778739.329025:0:5925:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790778739.329177:0:5925:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000b94afb7 00000080:02000400:2.0:1790778739.329188:0:5925:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:2.0:1790778739.339557:0:5925:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790778739.339566:0:5925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790778739.339605:0:5925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000009d071b3) 00000020:00000080:2.0:1790778739.339670:0:5925:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790778739.385484:0:5925:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1790778739.385615:0:5925:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1790778739.414132:0:5925:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790778739.414478:0:5925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790778739.414486:0:5925:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790778739.414498:0:5925:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc8763265607455c 00000020:01000004:2.0:1790778739.414505:0:5925:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1790778739.414510:0:5925:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790778739.414515:0:5925:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000b94afb7 from MGS 00000020:01000004:2.0:1790778739.414519:0:5925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790778739.414528:0:5925:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e853be1b) 00000020:00000080:2.0:1790778739.414538:0:5925:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790778739.414786:0:5925:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b94afb7 from MGS, refs=2 00080000:01000000:2.0:1790778739.414793:0:5925:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790778739.414801:0:5925:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc8763265607456a 00000100:00100000:2.0:1790778739.414895:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790778739.415107:0:5925:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790778739.415115:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790778739.425116:0:5925:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790778739.425131:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790778739.426982:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778739.427416:0:5925:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790778739.427425:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790778739.428615:0:5925:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790778739.428625:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790778739.429116:0:5925:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790778739.429123:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790778739.429902:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778739.429905:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778739.429907:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778739.430271:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778739.430274:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778739.430276:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778739.431146:0:5925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790778739.436114:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1790778739.680653:0:5925:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3347 MB/s 00000001:01000000:0.0:1790778739.930481:0:5925:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3503 MB/s 00000001:01000000:2.0:1790778740.181258:0:5925:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 667 MB/s 00000001:01000000:3.0:1790778740.432575:0:5925:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 710 MB/s 00080000:10000000:3.0:1790778740.443607:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1790778740.464733:0:5925:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790778740.470711:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790778740.470798:0:5925:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790778740.470850:0:5925:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1790778740.471071:0:5925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790778740.471096:0:5925:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790778740.474704:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790778740.474884:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790778740.474891:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790778740.475524:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790778740.475532:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790778740.480475:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790778740.480488:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790778740.481089:0:5925:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790778740.481109:0:5925:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:2.0:1790778740.481111:0:5925:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790778740.481166:0:5925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:2.0:1790778740.481180:0:5925:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.102@tcp (0000000026ee0ee6) 00000020:00000080:2.0:1790778740.481195:0:5925:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790778740.481269:0:5925:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a0a80a39@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1790778740.481468:0:5925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:2.0:1790778740.481475:0:5925:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790778740.482929:0:5945:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790778740.484337:0:5946:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790778740.484524:0:5925:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid 763f742b-0483-425a-8826-84839ee976ad) 00000020:00000080:2.0:1790778740.484551:0:5925:0:(genops.c:1384:class_connect()) connect: client 763f742b-0483-425a-8826-84839ee976ad, cookie 0xdc87632656074578 00000100:00080000:2.0:1790778740.484563:0:5925:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790778740.484572:0:5925:0:(import.c:666:import_select_connection()) MGC192.168.202.102@tcp: import 00000000a0a80a39 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778740.484628:0:5925:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000624ffb24 x1877767531528320/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790778740.484652:0:5925:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 763f742b-0483-425a-8826-84839ee976ad->MGS 00000020:01000004:2.0:1790778740.484673:0:5925:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790778740.484678:0:5925:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790778740.484691:0:5925:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b1f3ffda) 00000020:00000080:2.0:1790778740.484702:0:5925:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790778740.485882:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000624ffb24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:763f742b-0483-425a-8826-84839ee976ad:3438:1877767531528320:0@lo:250: 00000100:00100000:3.0:1790778740.485975:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778740.486078:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531528320 00000100:00100000:3.0:1790778740.486087:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531528320 00000100:00100000:3.0:1790778740.486129:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778740.486136:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f487e301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3438:x1877767531528320:12345-0@lo:250: 00010000:00080000:3.0:1790778740.486171:0:5942:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 763f742b-0483-425a-8826-84839ee976ad@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:3.0:1790778740.486196:0:5942:0:(genops.c:1384:class_connect()) connect: client 763f742b-0483-425a-8826-84839ee976ad, cookie 0xdc87632656074586 00000100:00080000:3.0:1790778740.486329:0:5942:0:(import.c:65:import_set_state_nolock()) 000000004842eaec : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778740.486383:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f487e301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+5:3438:x1877767531528320:12345-0@lo:250: Request processed in 247us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.486391:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778740.486433:0:3438:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790778740.486471:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:3.0:1790778740.486480:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790778740.486484:0:3438:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790778740.486487:0:3438:0:(import.c:65:import_set_state_nolock()) 00000000a0a80a39 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790778740.486490:0:3438:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790778740.486498:0:3438:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790778740.486502:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000624ffb24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:763f742b-0483-425a-8826-84839ee976ad:3438:1877767531528320:0@lo:250: 00010000:00010000:3.0:1790778740.494516:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778740.506333:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778740.506612:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790778740.506619:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790778740.507926:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790778740.507937:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790778740.508349:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790778740.508355:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790778740.509073:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778740.509218:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790778740.509221:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790778740.509777:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790778740.509790:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790778740.559348:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778740.559694:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790778740.559701:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790778740.561078:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790778740.561088:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790778740.562061:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778740.562363:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790778740.562370:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790778740.563406:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790778740.563424:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790778740.564055:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778740.564253:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790778740.564259:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790778740.565265:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790778740.565273:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790778740.565909:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790778740.566086:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790778740.566092:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790778740.566819:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790778740.566835:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790778740.588821:0:5925:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790778740.589068:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790778740.589076:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790778740.591349:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790778740.591367:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790778740.592409:0:5925:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790778740.592416:0:5925:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790778740.593107:0:5925:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790778740.593131:0:5925:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1790778740.593136:0:5925:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790778740.593233:0:5925:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790778740.593259:0:5925:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1790778740.593262:0:5925:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790778740.593263:0:5925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790778740.593264:0:5925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778740.593265:0:5925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778740.593266:0:5925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778740.593267:0:5925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778740.593268:0:5925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778740.593269:0:5925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790778740.593269:0:5925:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778740.593270:0:5925:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778740.593271:0:5925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778740.593272:0:5925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790778740.593274:0:5925:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1790778740.593275:0:5925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790778740.593276:0:5925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790778740.593279:0:5925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778740.593280:0:5925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778740.593280:0:5925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778740.593281:0:5925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778740.593281:0:5925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778740.593282:0:5925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790778740.593283:0:5925:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778740.593283:0:5925:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778740.593284:0:5925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778740.593284:0:5925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790778740.593317:0:5925:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790778740.593330:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528448:0@lo:253: 00000100:00100000:1.0:1790778740.593396:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.593472:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000106114a2 going to sleep for 11 seconds 00000100:00100000:2.0:1790778740.593543:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531528448 00000100:00100000:2.0:1790778740.593549:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531528448 00000100:00100000:2.0:1790778740.593589:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778740.593598:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000778fee9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+5:5925:x1877767531528448:12345-0@lo:253: 20000000:01000000:2.0:1790778740.593648:0:5944:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790778740.593652:0:5944:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790778740.594097:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790778740.594134:0:5944:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1790778740.594492:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778740.595369:0:5966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790778740.595662:0:5944:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790778740.595667:0:5944:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790778740.595673:0:5944:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790778740.595684:0:5944:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790778740.595699:0:5944:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790778740.595855:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778740.596017:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790778740.596030:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790778740.596048:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790778740.596066:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790778740.596097:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790778740.596153:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790778740.596161:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790778740.596175:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790778740.596180:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790778740.596192:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790778740.596198:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790778740.596207:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790778740.596221:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790778740.596248:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790778740.596252:0:5944:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790778740.596259:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778740.596343:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790778740.596352:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790778740.596365:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790778740.596378:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790778740.596392:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790778740.596400:0:5944:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790778740.596423:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790778740.596431:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790778740.596502:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790778740.596522:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790778740.596535:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790778740.596544:0:5944:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790778740.596566:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790778740.596592:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790778740.596609:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790778740.596638:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790778740.596702:0:5944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1790778740.596724:0:5944:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1790778740.596731:0:5944:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790778740.602306:0:5967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1790778740.602611:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1790778740.602645:0:5944:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.102@tcp for mdt 20000000:01000000:2.0:1790778740.602648:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:2.0:1790778740.602668:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1790778740.602675:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790778740.602688:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1790778740.602694:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:2.0:1790778740.602706:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1790778740.602714:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1790778740.602726:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1790778740.602740:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1790778740.602773:0:5944:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790778740.602777:0:5944:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790778740.602793:0:5944:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790778740.602854:0:5944:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790778740.602857:0:5944:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790778740.603187:0:5968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1790778740.603320:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1790778740.603340:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1790778740.603355:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1790778740.603363:0:5944:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790778740.603365:0:5944:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790778740.603677:0:5969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1790778740.603800:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790778740.603818:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1790778740.603833:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1790778740.603841:0:5944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790778740.603844:0:5944:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1790778740.603847:0:5944:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790778740.603849:0:5944:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790778740.603854:0:5944:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790778740.603860:0:5944:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790778740.604125:0:5970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1790778740.604215:0:5944:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1790778740.615992:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1790778740.616043:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1790778740.616060:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1790778740.616084:0:5944:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790778740.616109:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616130:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616141:0:5944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616147:0:5944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616153:0:5944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616184:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616191:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d0bbd7ef already unused, calling callback (0000000022d08975) 00010000:00010000:3.0:1790778740.616195:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616203:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616218:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616225:0:5944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.616231:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607458d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790778740.616270:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790778740.629849:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000778fee9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+5:5925:x1877767531528448:12345-0@lo:253: Request processed in 36244us (36444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.629867:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778740.629949:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528448:0@lo:253: 10000000:01000000:1.0:1790778740.629986:0:5925:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790778740.629991:0:5925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790778740.629994:0:5925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790778740.629997:0:5925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778740.629998:0:5925:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1790778740.630000:0:5925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778740.630002:0:5925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778740.630004:0:5925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778740.630006:0:5925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790778740.630009:0:5925:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790778740.630011:0:5925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778740.630013:0:5925:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790778740.630047:0:5925:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000b94afb7 from lustre-MDT0000 10000000:01000000:1.0:1790778740.630088:0:5925:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790778740.630091:0:5925:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790778740.630096:0:5925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ef2201619c0 10000000:01000000:1.0:1790778740.630099:0:5925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790778740.630109:0:5925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef2201619c0 from 1 10000000:01000000:1.0:1790778740.630112:0:5925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790778740.630159:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.630192:0:5925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.630203:0:5925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.630224:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528576:0@lo:101: 00000100:00100000:1.0:1790778740.630592:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.630665:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc27a36 going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.630673:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531528576 00000100:00100000:3.0:1790778740.630689:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531528576 00000100:00100000:3.0:1790778740.630858:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778740.630868:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000087508a50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+5:5925:x1877767531528576:12345-0@lo:101: 00010000:00010000:3.0:1790778740.630886:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778740.630905:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607459b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074594 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.630949:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607459b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074594 expref: 6 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.630962:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0bbd7ef/0xdc8763265607459b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074594 expref: 6 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.630970:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0bbd7ef, rc 0) 00000100:00100000:3.0:1790778740.631032:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000087508a50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+6:5925:x1877767531528576:12345-0@lo:101: Request processed in 166us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.631039:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778740.631081:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528576:0@lo:101: 00010000:00010000:1.0:1790778740.631101:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.631113:0:5925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.631184:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528704:0@lo:501: 00000100:00100000:1.0:1790778740.631213:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.631235:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc27a36 going to sleep for 11 seconds 00000100:00100000:2.0:1790778740.631284:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531528704 00000100:00100000:2.0:1790778740.631292:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531528704 00000100:00100000:2.0:1790778740.631329:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778740.631336:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000af4a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+6:5925:x1877767531528704:12345-0@lo:501: 00000100:00100000:2.0:1790778740.631468:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000af4a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+6:5925:x1877767531528704:12345-0@lo:501: Request processed in 104us (225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778740.631476:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790778740.631796:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528704:0@lo:501: 10000000:01000000:1.0:1790778740.632072:0:5925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790778740.632092:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.632101:0:5925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000cbce9401/0xdc87632656074594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778740.632130:0:5925:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef211145000 10000000:01000000:1.0:1790778740.632136:0:5925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790778740.632142:0:5925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ef211145000 10000000:01000000:1.0:1790778740.632145:0:5925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790778740.632148:0:5925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ef211145000 from 1 10000000:01000000:1.0:1790778740.632151:0:5925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790778740.632179:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.632187:0:5925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.632198:0:5925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.632214:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528832:0@lo:101: 00000100:00100000:1.0:1790778740.632787:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778740.632851:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531528832 00000100:00100000:2.0:1790778740.632862:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531528832 00000100:00100000:2.0:1790778740.632920:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790778740.632934:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007999d5c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+6:5925:x1877767531528832:12345-0@lo:101: 00010000:00010000:2.0:1790778740.632949:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790778740.633077:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc27a36 going to sleep for 11 seconds 00010000:00010000:2.0:1790778740.633152:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad29047e/0xdc876326560745a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560745a2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.633207:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad29047e/0xdc876326560745a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560745a2 expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.633220:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad29047e/0xdc876326560745a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560745a2 expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.633231:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad29047e, rc 0) 00000100:00100000:2.0:1790778740.633322:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007999d5c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+7:5925:x1877767531528832:12345-0@lo:101: Request processed in 390us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.633330:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778740.633384:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528832:0@lo:101: 00010000:00010000:1.0:1790778740.633403:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.633413:0:5925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778740.633429:0:5925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790778740.633464:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.633488:0:5925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000b16a6757/0xdc876326560745a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778740.633497:0:5925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790778740.633504:0:5925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790778740.633511:0:5925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ef211145000 10000000:01000000:1.0:1790778740.633514:0:5925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790778740.633517:0:5925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790778740.633521:0:5925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790778740.633544:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.633552:0:5925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.633561:0:5925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.633577:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528960:0@lo:101: 00000100:00100000:1.0:1790778740.633628:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.633659:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc27a36 going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.633682:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531528960 00000100:00100000:3.0:1790778740.633691:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531528960 00000100:00100000:3.0:1790778740.633746:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790778740.633758:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000076f6a6cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+7:5925:x1877767531528960:12345-0@lo:101: 00010000:00010000:3.0:1790778740.633775:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778740.633791:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055977578/0xdc876326560745b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560745b0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.633817:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055977578/0xdc876326560745b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560745b0 expref: 8 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.633831:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055977578/0xdc876326560745b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560745b0 expref: 8 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.633841:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055977578, rc 0) 00000100:00100000:3.0:1790778740.633934:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000076f6a6cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+8:5925:x1877767531528960:12345-0@lo:101: Request processed in 157us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.633947:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790778740.633948:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531528960:0@lo:101: 00010000:00010000:1.0:1790778740.633960:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.634042:0:5925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.634136:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529088:0@lo:501: 00000100:00100000:1.0:1790778740.634786:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.634856:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc27a36 going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.634857:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529088 00000100:00100000:3.0:1790778740.634873:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529088 00000100:00100000:3.0:1790778740.634951:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790778740.634964:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053667276 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+8:5925:x1877767531529088:12345-0@lo:501: 00000100:00100000:3.0:1790778740.635210:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053667276 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+9:5925:x1877767531529088:12345-0@lo:501: Request processed in 250us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.635218:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778740.635275:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529088:0@lo:501: 00000100:00100000:1.0:1790778740.635324:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529216:0@lo:503: 00000100:00100000:1.0:1790778740.635375:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.635396:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edc27a36 going to sleep for 11 seconds 00000100:00100000:2.0:1790778740.635594:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529216 00000100:00100000:2.0:1790778740.635601:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529216 00000100:00100000:2.0:1790778740.635638:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790778740.635645:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a665a3a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+9:5925:x1877767531529216:12345-0@lo:503: 00000100:00100000:2.0:1790778740.635922:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a665a3a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+9:5925:x1877767531529216:12345-0@lo:503: Request processed in 275us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.635934:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778740.637229:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529216:0@lo:503: 00000100:00100000:3.0:1790778740.638049:0:5971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006da59961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5971:1877767531529344:0@lo:502: 00000100:00100000:3.0:1790778740.638134:0:5971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778740.638187:0:5971:0:(client.c:2716:ptlrpc_set_wait()) set 000000004969a76b going to sleep for 11 seconds 00000100:00100000:0.0:1790778740.639028:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529344 00000100:00100000:0.0:1790778740.639039:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529344 00000100:00100000:0.0:1790778740.639108:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778740.639118:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c4a638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+9:5971:x1877767531529344:12345-0@lo:502: 00000100:00100000:0.0:1790778740.639399:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c4a638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+9:5971:x1877767531529344:12345-0@lo:502: Request processed in 284us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778740.639408:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790778740.643607:0:5971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006da59961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5971:1877767531529344:0@lo:502: 00000020:01000000:2.0:1790778740.643771:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778740.643798:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778740.643801:0:5971:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790778740.643807:0:5971:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790778740.643810:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790778740.643866:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eea76229) 00000020:00000080:2.0:1790778740.643905:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790778740.643915:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790778740.644064:0:5971:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790778740.644071:0:5971:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc876326560745c5 00000020:00000080:2.0:1790778740.644395:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790778740.644407:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778740.644414:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778740.644415:0:5971:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790778740.644418:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778740.644423:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778740.644425:0:5971:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790778740.644428:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790778740.644490:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d4101486) 00000020:00000080:2.0:1790778740.644508:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790778740.644516:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790778740.644518:0:5971:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790778740.644521:0:5971:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790778740.644526:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790778740.644598:0:5971:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b94afb7 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790778740.644690:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005ab5f6c0) 00000020:00000080:2.0:1790778740.644698:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790778740.644798:0:5971:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790778740.644804:0:5971:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc876326560745da 00000020:00000080:2.0:1790778740.645522:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790778740.645532:0:5971:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790778740.645538:0:5971:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdc876326560745e1 00080000:01000000:2.0:1790778740.645544:0:5971:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790778740.645548:0:5971:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc876326560745e8 00080000:10000000:2.0:1790778740.646125:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1790778740.646289:0:5971:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790778740.650180:0:5971:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790778740.768318:0:5971:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790778740.768814:0:5971:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790778740.778759:0:5971:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790778740.779171:0:5971:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790778740.783087:0:5971:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000006cd1f15) 00000020:00000080:2.0:1790778740.783109:0:5971:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790778740.783205:0:5971:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790778740.783214:0:5971:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc876326560745f6 00000020:00000080:2.0:1790778740.784783:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790778740.785850:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.792800:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.801882:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.805006:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.814563:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.818329:0:5971:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1790778740.820036:0:5971:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdc876326560745fd 00000020:00000080:0.0:1790778740.820346:0:5971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790778740.820359:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778740.820366:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778740.820368:0:5971:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790778740.820370:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778740.820374:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778740.820375:0:5971:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790778740.820378:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790778740.820379:0:5971:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790778740.820381:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778740.820383:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778740.820384:0:5971:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790778740.820386:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778740.820390:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778740.820391:0:5971:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790778740.820394:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790778740.820456:0:5971:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1790778740.820525:0:5971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5971:1877767531529472:0@lo:502: 00000100:00100000:0.0:1790778740.820614:0:5971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778740.820677:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529472 00000100:00100000:0.0:1790778740.820679:0:5971:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061bbd925 going to sleep for 11 seconds 00000100:00100000:2.0:1790778740.820685:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529472 00000100:00100000:2.0:1790778740.820731:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778740.820740:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009b5a9459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+9:5971:x1877767531529472:12345-0@lo:502: 00000100:00100000:2.0:1790778740.820856:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009b5a9459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+9:5971:x1877767531529472:12345-0@lo:502: Request processed in 117us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.820864:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790778740.820899:0:5971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5971:1877767531529472:0@lo:502: 00000020:01000000:0.0:1790778740.820931:0:5971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778740.820935:0:5971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778740.820936:0:5971:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1790778740.820940:0:5971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790778740.821027:0:5925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790778740.821056:0:5925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790778740.821078:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.821089:0:5925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000079848799/0xdc876326560745b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778740.821097:0:5925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef211145000 from 1 10000000:01000000:1.0:1790778740.821100:0:5925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790778740.821125:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.821132:0:5925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.821140:0:5925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.821178:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529600:0@lo:101: 00000100:00100000:1.0:1790778740.821206:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.821228:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c151e9c going to sleep for 11 seconds 00000100:00100000:0.0:1790778740.821245:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529600 00000100:00100000:0.0:1790778740.821250:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529600 00000100:00100000:0.0:1790778740.821334:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778740.821342:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c931dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+9:5925:x1877767531529600:12345-0@lo:101: 00010000:00010000:0.0:1790778740.821351:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778740.821368:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074604 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.821388:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074604 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.821398:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074604 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.821406:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000793f571a, rc 0) 00000100:00100000:0.0:1790778740.821438:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c931dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+10:5925:x1877767531529600:12345-0@lo:101: Request processed in 99us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778740.821487:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778740.821735:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529600:0@lo:101: 00010000:00010000:1.0:1790778740.821746:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.821754:0:5925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.822368:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529728:0@lo:256: 00000100:00100000:1.0:1790778740.822417:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778740.822494:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529728 00000100:00100000:3.0:1790778740.822500:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529728 00000100:00100000:1.0:1790778740.822501:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c151e9c going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.822526:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790778740.822534:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001b1618ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+10:5925:x1877767531529728:12345-0@lo:256: 20000000:01000000:3.0:1790778740.822549:0:5942:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790778740.822556:0:5942:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790778740.823298:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001b1618ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+10:5925:x1877767531529728:12345-0@lo:256: Request processed in 763us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.823308:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790778740.824567:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529728:0@lo:256: 10000000:01000000:1.0:1790778740.825140:0:5925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790778740.825155:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.825178:0:5925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778740.825187:0:5925:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef211145000 from 1 10000000:01000000:1.0:1790778740.825190:0:5925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778740.825226:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.825233:0:5925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.825251:0:5925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.825269:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529856:0@lo:101: 00000100:00100000:1.0:1790778740.825320:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.825373:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c151e9c going to sleep for 11 seconds 00000100:00100000:0.0:1790778740.825373:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529856 00000100:00100000:0.0:1790778740.825382:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529856 00000100:00100000:0.0:1790778740.825462:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790778740.825471:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006928d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+10:5925:x1877767531529856:12345-0@lo:101: 00010000:00010000:0.0:1790778740.825484:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778740.825496:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074612 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.825527:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074612 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.825537:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074612 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.825546:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034afc530, rc 0) 00000100:00100000:0.0:1790778740.825590:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006928d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:5925:x1877767531529856:12345-0@lo:101: Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778740.825597:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778740.825655:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529856:0@lo:101: 00010000:00010000:1.0:1790778740.825668:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.825675:0:5925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778740.825725:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529984:0@lo:501: 00000100:00100000:1.0:1790778740.825748:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.825776:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c151e9c going to sleep for 11 seconds 00000100:00100000:0.0:1790778740.825812:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531529984 00000100:00100000:0.0:1790778740.825817:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531529984 00000100:00100000:0.0:1790778740.825846:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790778740.825853:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b30fed94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+11:5925:x1877767531529984:12345-0@lo:501: 00000100:00100000:0.0:1790778740.826008:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b30fed94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+11:5925:x1877767531529984:12345-0@lo:501: Request processed in 156us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778740.826015:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778740.826024:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531529984:0@lo:501: 00000100:00100000:1.0:1790778740.826048:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530112:0@lo:503: 00000100:00100000:1.0:1790778740.826086:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.826107:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c151e9c going to sleep for 11 seconds 00000100:00100000:2.0:1790778740.826151:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530112 00000100:00100000:2.0:1790778740.826165:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530112 00000100:00100000:2.0:1790778740.826198:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778740.826204:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008d8c63c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:5925:x1877767531530112:12345-0@lo:503: 00000040:00080000:2.0:1790778740.826234:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778740.826279:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008d8c63c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:5925:x1877767531530112:12345-0@lo:503: Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.826286:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790778740.826407:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530112:0@lo:503: 00000040:00080000:3.0:1790778740.827475:0:5975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1790778740.827589:0:5925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1790778740.827610:0:5925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778740.827631:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.827655:0:5925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778740.827709:0:5925:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790778740.827715:0:5925:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef211145000 10000000:01000000:1.0:1790778740.827717:0:5925:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef211145000 10000000:01000000:0.0:1790778740.827847:0:5925:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790778740.827854:0:5925:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef211145000 from 1 10000000:01000000:0.0:1790778740.827856:0:5925:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790778740.827882:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.827887:0:5925:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.827893:0:5925:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778740.827914:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530240:0@lo:101: 00000100:00100000:0.0:1790778740.827958:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778740.827994:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530240 00000100:00100000:3.0:1790778740.828000:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530240 00000100:00100000:0.0:1790778740.828002:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fa53ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.828070:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778740.828079:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000043f146b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:5925:x1877767531530240:12345-0@lo:101: 00010000:00010000:3.0:1790778740.828097:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778740.828108:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055a7b6bf/0xdc87632656074627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074620 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.828126:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055a7b6bf/0xdc87632656074627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074620 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.828134:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055a7b6bf/0xdc87632656074627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074620 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.828141:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055a7b6bf, rc 0) 00000100:00100000:3.0:1790778740.828195:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000043f146b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531530240:12345-0@lo:101: Request processed in 118us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.828202:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790778740.828218:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530240:0@lo:101: 00010000:00010000:0.0:1790778740.828229:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.828237:0:5925:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778740.828307:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530368:0@lo:501: 00000100:00100000:0.0:1790778740.828332:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778740.828353:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fa53ce7 going to sleep for 11 seconds 00000100:00100000:1.0:1790778740.828378:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530368 00000100:00100000:1.0:1790778740.828382:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530368 00000100:00100000:1.0:1790778740.828422:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790778740.828428:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d5582f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531530368:12345-0@lo:501: 00000100:00100000:1.0:1790778740.828664:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d5582f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531530368:12345-0@lo:501: Request processed in 236us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778740.828671:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790778740.829078:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530368:0@lo:501: 00000100:00100000:0.0:1790778740.829106:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530496:0@lo:503: 00000100:00100000:0.0:1790778740.829137:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778740.829163:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fa53ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.829229:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530496 00000100:00100000:3.0:1790778740.829235:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530496 00000100:00100000:3.0:1790778740.829268:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790778740.829274:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000962b3ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531530496:12345-0@lo:503: 00000100:00100000:3.0:1790778740.829360:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000962b3ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531530496:12345-0@lo:503: Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.829366:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790778740.829764:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531530496:0@lo:503: 00000100:00100000:3.0:1790778740.832069:0:5976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006da59961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5976:1877767531530624:0@lo:502: 00000100:00100000:3.0:1790778740.832159:0:5976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778740.832294:0:5976:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd9a2b48 going to sleep for 11 seconds 00000100:00100000:2.0:1790778740.832438:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530624 00000100:00100000:2.0:1790778740.832620:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530624 00000100:00100000:2.0:1790778740.832701:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778740.832711:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009614d4b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:5976:x1877767531530624:12345-0@lo:502: 00000100:00100000:2.0:1790778740.832849:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009614d4b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:5976:x1877767531530624:12345-0@lo:502: Request processed in 140us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.832866:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790778740.832944:0:5976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006da59961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5976:1877767531530624:0@lo:502: 00000020:01000004:0.0:1790778740.833016:0:5976:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790778740.833041:0:5976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ea4b6efe) 00000020:00000080:0.0:1790778740.833060:0:5976:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1790778740.833188:0:5976:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000b94afb7 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790778740.833193:0:5976:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000b94afb7 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790778740.833200:0:5976:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000b94afb7 4 00010000:00080000:0.0:1790778740.833234:0:5976:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002da1b1a6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1790778740.834957:0:5976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1790778740.835168:0:5976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790778740.835204:0:5976:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790778740.835217:0:5976:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdc87632656074635 00000100:00080000:0.0:1790778740.835227:0:5976:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778740.835237:0:5976:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002da1b1a6 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1790778740.835271:0:5976:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008de19efe x1877767531530752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790778740.835320:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531530752:0@lo:38: 00000100:00100000:0.0:1790778740.835387:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790778740.835489:0:5976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790778740.841863:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530752 00000100:00100000:3.0:1790778740.841881:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530752 00000100:00100000:3.0:1790778740.841981:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778740.841990:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a9835cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531530752:12345-0@lo:38: 00000100:00100000:3.0:1790778740.842116:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a9835cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531530752:12345-0@lo:38: Request processed in 126us (6728us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790778740.842124:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778740.844561:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790778740.844577:0:3438:0:(import.c:65:import_set_state_nolock()) 000000002da1b1a6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790778740.844595:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790778740.844600:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de19efe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531530752:0@lo:38: 00000100:00100000:2.0:1790778740.848283:0:5976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4895aad pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5976:1877767531530880:0@lo:502: 00000100:00100000:2.0:1790778740.848394:0:5976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778740.848472:0:5976:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e84ef04d going to sleep for 11 seconds 00000100:00100000:1.0:1790778740.848708:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531530880 00000100:00100000:1.0:1790778740.848717:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531530880 00000100:00100000:1.0:1790778740.848771:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790778740.848780:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000773b78a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5976:x1877767531530880:12345-0@lo:502: 00000100:00100000:1.0:1790778740.848898:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000773b78a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5976:x1877767531530880:12345-0@lo:502: Request processed in 120us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778740.848906:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790778740.849189:0:5976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4895aad pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:5976:1877767531530880:0@lo:502: 00000040:00080000:2.0:1790778740.849216:0:5976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790778740.849409:0:5925:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790778740.849435:0:5925:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778740.849470:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778740.849482:0:5925:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 000000004447d38a/0xdc87632656074620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790778740.849538:0:5925:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790778740.849540:0:5925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790778740.849542:0:5925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778740.849543:0:5925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778740.849545:0:5925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778740.849546:0:5925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778740.849547:0:5925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778740.849549:0:5925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790778740.849551:0:5925:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778740.849552:0:5925:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778740.849554:0:5925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778740.849555:0:5925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790778740.849559:0:5925:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790778740.849561:0:5925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790778740.849563:0:5925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790778740.849564:0:5925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778740.849565:0:5925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778740.849566:0:5925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778740.849567:0:5925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778740.849568:0:5925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778740.849569:0:5925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790778740.849570:0:5925:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778740.849571:0:5925:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778740.849572:0:5925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778740.849574:0:5925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790778740.849597:0:5925:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790778740.849607:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531531008:0@lo:253: 00000100:00100000:1.0:1790778740.849635:0:5925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778740.849661:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set 00000000106114a2 going to sleep for 11 seconds 00000100:00100000:1.0:1790778740.849675:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531008 00000100:00100000:1.0:1790778740.849680:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531008 00000100:00100000:1.0:1790778740.849706:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790778740.849712:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000087e7ee11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531531008:12345-0@lo:253: 20000000:01000000:1.0:1790778740.849731:0:5942:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790778740.849748:0:5942:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790778740.860884:0:5942:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790778740.860943:0:5942:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790778740.861426:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000087e7ee11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5925:x1877767531531008:12345-0@lo:253: Request processed in 11708us (11784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.861464:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790778740.861594:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d566097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:5925:1877767531531008:0@lo:253: 10000000:01000000:1.0:1790778740.861607:0:5925:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790778740.861610:0:5925:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790778740.861612:0:5925:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790778740.861614:0:5925:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790778740.861615:0:5925:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790778740.861616:0:5925:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790778740.861617:0:5925:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790778740.861619:0:5925:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790778740.861620:0:5925:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790778740.861622:0:5925:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790778740.861623:0:5925:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790778740.861625:0:5925:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790778740.861626:0:5925:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790778740.861645:0:5925:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790778740.866405:0:5965:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790778740.866417:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790778740.866506:0:5965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.866529:0:5965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074604 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.866538:0:5965:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.866594:0:5965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074604 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778740.866611:0:5965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074604 expref: 11 pid: 5943 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778740.866625:0:5965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c822cc7e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1877767531531136:0@lo:104: 00000100:00100000:0.0:1790778740.866717:0:5965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778740.866791:0:5965:0:(client.c:2716:ptlrpc_set_wait()) set 00000000082a002f going to sleep for 11 seconds 00000100:00100000:3.0:1790778740.867168:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531136 00000100:00100000:3.0:1790778740.867177:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531136 00000100:00100000:3.0:1790778740.867230:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778740.867238:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c23229d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5965:x1877767531531136:12345-0@lo:104: 00010000:00010000:3.0:1790778740.867251:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778740.867516:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790778740.867522:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c23229d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5965:x1877767531531136:12345-0@lo:104: Request processed in 285us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778740.867528:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790778740.867625:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778740.867631:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.867638:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067e1b5ac already unused, calling callback (000000008f785c72) 10000000:00010000:2.0:1790778740.867641:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.867648:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778740.867654:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778740.867667:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778740.867692:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.867699:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778740.867718:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.867724:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: 0000000067e1b5ac/0xdc87632656074604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607460b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.867741:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778740.867742:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778740.867744:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778740.867888:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4895aad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531531264:0@lo:103: 00000100:00100000:3.0:1790778740.867922:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778740.868032:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531264 00000100:00100000:2.0:1790778740.868037:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531264 00010000:00010000:2.0:1790778740.868058:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074604 expref: 12 pid: 5943 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778740.868085:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778740.868092:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004cf16d7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+12:3440:x1877767531531264:12345-0@lo:103: 00010000:00010000:2.0:1790778740.868103:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778740.868107:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074604 expref: 12 pid: 5943 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868116:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074604 expref: 12 pid: 5943 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868134:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868149:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790778740.868165:0:5933:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001748446s 00010000:00010000:2.0:1790778740.868169:0:5933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868175:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868182:0:5933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868188:0:5933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868193:0:5933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d46dcca already unused, calling callback (0000000022d08975) 00010000:00010000:2.0:1790778740.868197:0:5933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868203:0:5933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868211:0:5933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868221:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778740.868251:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004cf16d7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+12:3440:x1877767531531264:12345-0@lo:103: Request processed in 161us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778740.868258:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790778740.868517:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000793f571a/0xdc8763265607460b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074604 expref: 11 pid: 5943 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778740.868529:0:5965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c822cc7e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1877767531531136:0@lo:104: 00010000:00010000:2.0:1790778740.868546:0:5965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868555:0:5965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868560:0:5965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778740.868566:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008d46dcca/0xdc8763265607463c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778740.869076:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4895aad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531531264:0@lo:103: 00080000:10000000:0.0:1790778740.872235:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1790778740.872480:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1790778740.872725:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1790778740.872873:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1790778740.873013:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1790778740.873124:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1790778740.877008:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.877119:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1790778740.877239:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.877760:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1790778740.877901:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1790778740.878051:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1790778740.891743:0:5925:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790778740.914575:0:5925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1790778740.914761:0:5981:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790778740.914766:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790778740.914968:0:5982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790778740.917537:0:5925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790778740.918826:0:5925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790778740.919436:0:5925:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790778740.919483:0:5925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790778740.919771:0:5925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778740.921063:0:5925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790778740.923238:0:5925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790778740.923302:0:5925:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790778740.923982:0:5925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790778740.924685:0:5925:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1790778740.925794:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790778740.925971:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790778740.926256:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790778740.926693:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790778740.926848:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:1.0:1790778740.926939:0:5982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1790778740.926981:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790778740.927688:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790778740.929617:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790778740.929788:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790778740.929929:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790778740.930132:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790778740.930294:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790778740.930432:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790778740.930609:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790778740.930778:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790778740.930910:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790778740.931207:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790778740.931367:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790778740.931534:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790778740.931687:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790778740.931854:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790778740.932006:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790778740.932132:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790778740.932255:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790778740.932390:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:1.0:1790778740.935772:0:5982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790778740.935864:0:5982:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790778740.935869:0:5982:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1790778740.937012:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790778740.937606:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790778740.937754:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790778740.937900:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790778740.938066:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790778740.938749:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790778740.938889:0:5925:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790778740.939105:0:5925:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1790778740.943622:0:5925:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790778740.943664:0:5925:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac181ca7988 00100000:10000000:3.0:1790778740.943672:0:5925:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790778740.944248:0:5925:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790778740.944274:0:5925:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790778740.944307:0:5925:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790778740.944334:0:5925:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1790778740.947221:0:5925:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778740.948712:0:5925:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1790778741.519294:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778742.539963:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778743.568869:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778744.587717:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790778745.590593:0:6226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790778745.612269:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790778745.867641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790778745.867653:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790778745.867656:0:36:0:(import.c:65:import_set_state_nolock()) 000000002da1b1a6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790778745.867683:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002da1b1a6 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1790778745.867707:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000746868eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531531392:0@lo:400: 00000100:00100000:2.0:1790778745.867707:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a92482c x1877767531531520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790778745.867772:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a92482c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531531520:0@lo:38: 00000100:00100000:3.0:1790778745.867779:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778745.868723:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531392 00000100:00100000:0.0:1790778745.868735:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531392 00000100:00100000:0.0:1790778745.868787:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790778745.868796:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f034d493 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:3441:x1877767531531392:12345-0@lo:400: 00000100:00100000:2.0:1790778745.873011:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778745.873171:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531520 00000100:00100000:2.0:1790778745.873185:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531520 00000100:00100000:2.0:1790778745.873227:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778745.873235:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a2339d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1877767531531520:12345-0@lo:38: 00010000:00080000:2.0:1790778745.873268:0:5951:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:2.0:1790778745.873304:0:5951:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdc87632656074643 00000004:00100000:2.0:1790778745.873356:0:5951:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790778745.873550:0:5951:0:(import.c:65:import_set_state_nolock()) 000000006c7948e9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778745.873628:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a2339d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3438:x1877767531531520:12345-0@lo:38: Request processed in 392us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778745.873637:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790778745.876083:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008a92482c x1877767531531520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790778745.876109:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790778745.876117:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790778745.876122:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790778745.876125:0:3438:0:(import.c:65:import_set_state_nolock()) 000000002da1b1a6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790778745.876132:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a92482c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531531520:0@lo:38: 00000100:00100000:1.0:1790778745.876719:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f034d493 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:3441:x1877767531531392:12345-0@lo:400: Request processed in 7920us (8935us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778745.876733:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778745.876800:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000746868eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531531392:0@lo:400: 10000000:01000000:0.0:1790778746.381047:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790778746.381057:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef211145000 from 3 10000000:01000000:0.0:1790778746.381062:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790778746.381112:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.381125:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.381153:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778746.381177:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9d20018 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531531648:0@lo:101: 00000100:00100000:0.0:1790778746.381256:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778746.381323:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 00000000180fac68 going to sleep for 11 seconds 00000100:00100000:1.0:1790778746.381379:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531648 00000100:00100000:1.0:1790778746.381389:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531648 00000100:00100000:0.0:1790778746.383192:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790778746.383215:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000303d08ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:5946:x1877767531531648:12345-0@lo:101: 00010000:00010000:0.0:1790778746.383239:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778746.383263:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c9a5e6d/0xdc87632656074651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607464a expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.383299:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c9a5e6d/0xdc87632656074651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607464a expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.383311:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c9a5e6d/0xdc87632656074651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607464a expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.383319:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c9a5e6d, rc 0) 00000100:00100000:0.0:1790778746.383426:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000303d08ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531531648:12345-0@lo:101: Request processed in 222us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778746.383434:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790778746.383641:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9d20018 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531531648:0@lo:101: 00010000:00010000:3.0:1790778746.383664:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778746.383673:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778746.383768:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bca97777 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531531776:0@lo:256: 00000100:00100000:3.0:1790778746.383811:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778746.383862:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 000000007acb0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778746.384028:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531776 00000100:00100000:0.0:1790778746.384038:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531776 00000100:00100000:0.0:1790778746.384093:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778746.384100:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001a82a6ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531531776:12345-0@lo:256: 20000000:01000000:0.0:1790778746.384116:0:5943:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790778746.384140:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790778746.384144:0:5943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790778746.384231:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001a82a6ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531531776:12345-0@lo:256: Request processed in 131us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778746.384240:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778746.384275:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bca97777 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531531776:0@lo:256: 10000000:01000000:0.0:1790778746.384317:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790778746.384324:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.384331:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 000000008d46dcca/0xdc8763265607464a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778746.639089:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790778746.690116:0:6278:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778746.690306:0:6278:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790778747.659850:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778748.685151:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790778749.345113:0:6380:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790778749.345325:0:6380:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790778749.708216:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790778750.325132:0:6429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe60d95e50 20000000:00000080:2.0:1790778750.325152:0:6429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef2330cd000 uarg=0000000000000000 20000000:01000000:2.0:1790778750.325193:0:6429:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790778750.325201:0:6429:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790778750.325206:0:6429:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790778750.325294:0:6429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790778750.325307:0:6429:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790778750.337821:0:6429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778750.338035:0:6429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790778750.338063:0:6429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1790778750.338076:0:6429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1790778750.338090:0:6429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790778750.338107:0:6429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.338125:0:6429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074612 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.338132:0:6429:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.338180:0:6429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074612 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.338193:0:6429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074612 expref: 11 pid: 5943 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778750.338208:0:6429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a92482c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6429:1877767531531904:0@lo:104: 00000100:00100000:2.0:1790778750.338285:0:6429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778750.338346:0:6429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029362198 going to sleep for 11 seconds 00000100:00100000:3.0:1790778750.338394:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531531904 00000100:00100000:3.0:1790778750.338402:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531531904 00000100:00100000:3.0:1790778750.338496:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790778750.338505:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d13bc15f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:6429:x1877767531531904:12345-0@lo:104: 00010000:00010000:3.0:1790778750.338518:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778750.340297:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790778750.340309:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d13bc15f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:6429:x1877767531531904:12345-0@lo:104: Request processed in 1804us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778750.340321:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1790778750.340394:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778750.340402:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340412:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000116a1bfb already unused, calling callback (000000008f785c72) 10000000:00010000:0.0:1790778750.340415:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340423:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778750.340429:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778750.340470:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790778750.340531:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340539:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778750.340559:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340566:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: 00000000116a1bfb/0xdc87632656074612 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074619 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340584:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778750.340586:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778750.340588:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778750.340602:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad89b1fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531532032:0@lo:103: 00000100:00100000:0.0:1790778750.340654:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778750.340723:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532032 00000100:00100000:0.0:1790778750.340729:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532032 00010000:00010000:0.0:1790778750.340754:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074612 expref: 12 pid: 5943 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778750.340797:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778750.340805:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009ab27688 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+12:3442:x1877767531532032:12345-0@lo:103: 00010000:00010000:0.0:1790778750.340817:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778750.340821:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074612 expref: 12 pid: 5943 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340831:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074612 expref: 12 pid: 5943 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340856:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340864:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340879:0:5933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340900:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340906:0:5933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340911:0:5933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340916:0:5933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000221e855 already unused, calling callback (0000000022d08975) 00010000:00010000:0.0:1790778750.340920:0:5933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340927:0:5933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340934:0:5933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778750.340944:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778750.340993:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009ab27688 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+12:3442:x1877767531532032:12345-0@lo:103: Request processed in 177us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778750.341010:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778750.341054:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad89b1fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531532032:0@lo:103: 00010000:00010000:2.0:1790778750.347269:0:6429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034afc530/0xdc87632656074619 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074612 expref: 11 pid: 5943 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778750.347311:0:6429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a92482c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6429:1877767531531904:0@lo:104: 00010000:00010000:2.0:1790778750.347334:0:6429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.347344:0:6429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.348923:0:6429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778750.348943:0:6429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000221e855/0xdc87632656074658 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778750.732470:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778750.988985:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790778750.989016:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a92482c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531532160:0@lo:400: 00000100:00100000:2.0:1790778750.989084:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778750.989178:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532160 00000100:00100000:2.0:1790778750.989190:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532160 00000100:00100000:2.0:1790778750.989248:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778750.989258:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003b665bff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531532160:12345-0@lo:400: 00000100:00100000:2.0:1790778750.989310:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003b665bff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531532160:12345-0@lo:400: Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778750.989318:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790778750.989374:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008a92482c x1877767531532160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778750.989388:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a92482c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531532160:0@lo:400: 00010000:00010000:0.0:1790778751.755557:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778752.780736:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778753.803620:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778754.835223:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790778755.597643:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790778755.597651:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef211145000 from 1 10000000:01000000:0.0:1790778755.597657:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790778755.597703:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000cf93f05b/0xdc8763265607465f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778755.597716:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000cf93f05b/0xdc8763265607465f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778755.597726:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000cf93f05b/0xdc8763265607465f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778755.597748:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad89b1fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531532288:0@lo:101: 00000100:00100000:0.0:1790778755.597809:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778755.597863:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b812492 going to sleep for 11 seconds 00000100:00100000:3.0:1790778755.597934:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532288 00000100:00100000:3.0:1790778755.597943:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532288 00000100:00100000:3.0:1790778755.597988:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790778755.597996:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000041913396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:5946:x1877767531532288:12345-0@lo:101: 00010000:00010000:3.0:1790778755.598011:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778755.598021:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005848d157/0xdc87632656074666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607465f expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778755.598041:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005848d157/0xdc87632656074666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607465f expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778755.598051:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005848d157/0xdc87632656074666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607465f expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778755.598059:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005848d157, rc 0) 00000100:00100000:3.0:1790778755.598099:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000041913396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531532288:12345-0@lo:101: Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778755.598107:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790778755.598163:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad89b1fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531532288:0@lo:101: 00010000:00010000:3.0:1790778755.598196:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000cf93f05b/0xdc8763265607465f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778755.598204:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000cf93f05b/0xdc8763265607465f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778755.598265:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000448672fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531532416:0@lo:501: 00000100:00100000:3.0:1790778755.598291:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778755.598313:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db14d2f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790778755.598623:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532416 00000100:00100000:0.0:1790778755.598629:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532416 00000100:00100000:0.0:1790778755.598651:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790778755.598657:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000568b35a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531532416:12345-0@lo:501: 00000100:00100000:0.0:1790778755.598761:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000568b35a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531532416:12345-0@lo:501: Request processed in 104us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778755.598768:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778755.599284:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000448672fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531532416:0@lo:501: 00000100:00100000:3.0:1790778755.599334:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000448672fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531532544:0@lo:503: 00000100:00100000:3.0:1790778755.599370:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778755.599411:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db14d2f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790778755.599483:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532544 00000100:00100000:0.0:1790778755.599488:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532544 00000100:00100000:0.0:1790778755.599528:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790778755.599535:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000708da543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531532544:12345-0@lo:503: 00000100:00100000:0.0:1790778755.599631:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000708da543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531532544:12345-0@lo:503: Request processed in 97us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778755.599639:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778755.599662:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000448672fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531532544:0@lo:503: 00000100:00100000:3.0:1790778755.600717:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000448672fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:6649:1877767531532672:0@lo:502: 00000100:00100000:3.0:1790778755.600766:0:6649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778755.600799:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c740d6c going to sleep for 11 seconds 00000100:00100000:0.0:1790778755.601423:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532672 00000100:00100000:0.0:1790778755.601430:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532672 00000100:00100000:0.0:1790778755.601493:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790778755.601500:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000046a8325a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6649:x1877767531532672:12345-0@lo:502: 00000100:00100000:0.0:1790778755.602042:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000046a8325a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6649:x1877767531532672:12345-0@lo:502: Request processed in 542us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778755.602051:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778755.602140:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000448672fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:6649:1877767531532672:0@lo:502: 00000020:01000000:3.0:1790778755.602931:0:6649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778755.602941:0:6649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778755.602944:0:6649:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790778755.602953:0:6649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef211145000 00000020:00000080:3.0:1790778755.602955:0:6649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790778755.603005:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:6649:1877767531532800:0@lo:502: 00000100:00100000:3.0:1790778755.603051:0:6649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778755.603089:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2086933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778755.603249:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532800 00000100:00100000:0.0:1790778755.603256:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532800 00000100:00100000:0.0:1790778755.603288:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790778755.603295:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:6649:x1877767531532800:12345-0@lo:502: 00000100:00100000:0.0:1790778755.603379:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:6649:x1877767531532800:12345-0@lo:502: Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778755.603385:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790778755.603498:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:6649:1877767531532800:0@lo:502: 00000020:01000000:3.0:1790778755.603515:0:6649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778755.603519:0:6649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778755.603520:0:6649:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790778755.603523:0:6649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790778755.604383:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790778755.604410:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790778755.604420:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778755.604432:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778755.853586:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778756.115987:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778756.117652:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531532928:0@lo:400: 00000100:00100000:1.0:1790778756.117735:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778756.117849:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531532928 00000100:00100000:1.0:1790778756.117858:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531532928 00000100:00100000:1.0:1790778756.117904:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778756.117913:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531532928:12345-0@lo:400: 00000100:00100000:1.0:1790778756.117968:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531532928:12345-0@lo:400: Request processed in 56us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778756.117975:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790778756.118017:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef206d77480 x1877767531532928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778756.118032:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531532928:0@lo:400: 00010000:00010000:2.0:1790778756.882544:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778757.901524:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778758.923674:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778759.947683:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778760.973471:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778761.228336:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531533056:0@lo:400: 00000100:00100000:3.0:1790778761.228466:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778761.228539:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778761.228545:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531533184:0@lo:400: 00000100:00100000:3.0:1790778761.228581:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778761.228622:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533056 00000100:00100000:3.0:1790778761.228631:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533056 00000100:00100000:3.0:1790778761.228685:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778761.228694:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:3441:x1877767531533056:12345-0@lo:400: 00000100:00100000:3.0:1790778761.228746:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:3441:x1877767531533056:12345-0@lo:400: Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.228755:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778761.228789:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533184 00000100:00100000:3.0:1790778761.228792:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533184 00000100:00100000:3.0:1790778761.228822:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778761.228829:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531533184:12345-0@lo:400: 00000100:00100000:3.0:1790778761.228864:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531533184:12345-0@lo:400: Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.228871:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790778761.228933:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef205c02d80 x1877767531533184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778761.228950:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531533184:0@lo:400: 00000100:00100000:3.0:1790778761.228969:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531533056:0@lo:400: 00000020:01000004:3.0:1790778761.385694:0:6928:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790778761.385701:0:6928:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790778761.385702:0:6928:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790778761.387296:0:6928:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef2332da000 00000020:01000004:3.0:1790778761.387323:0:6928:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790778761.387338:0:6928:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790778761.387368:0:6928:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ef23b814d40) 00000020:00000080:3.0:1790778761.387399:0:6928:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790778761.472149:0:6928:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790778761.472313:0:6928:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1790778761.511250:0:6928:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790778761.511583:0:6928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790778761.511597:0:6928:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790778761.511612:0:6928:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdc87632656074674 00000020:01000004:2.0:1790778761.511621:0:6928:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790778761.511651:0:6928:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790778761.511656:0:6928:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790778761.511664:0:6928:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790778761.511670:0:6928:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790778761.511695:0:6928:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ef23b9a0000) 00000020:00000080:2.0:1790778761.511708:0:6928:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790778761.513198:0:6928:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778761.513412:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790778761.513419:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790778761.514756:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790778761.514768:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790778761.528208:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790778761.528233:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790778761.535100:0:6928:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778761.535361:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790778761.535370:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790778761.540932:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790778761.540950:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790778761.584248:0:6928:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778761.584750:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790778761.584759:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790778761.590670:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790778761.590694:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790778761.592983:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790778761.593012:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790778761.598677:0:6928:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790778761.598942:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790778761.598950:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790778761.601837:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790778761.601865:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790778761.667744:0:6928:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790778761.668636:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790778761.668645:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790778761.672360:0:6928:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790778761.672395:0:6928:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790778761.673370:0:6928:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790778761.673420:0:6928:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790778761.673429:0:6928:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790778761.713424:0:6928:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790778761.713508:0:6928:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1790778761.713513:0:6928:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790778761.713515:0:6928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790778761.713517:0:6928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778761.713518:0:6928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778761.713521:0:6928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778761.713523:0:6928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778761.713525:0:6928:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778761.713527:0:6928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778761.713529:0:6928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778761.713531:0:6928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778761.713533:0:6928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790778761.713539:0:6928:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1790778761.713541:0:6928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790778761.713543:0:6928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790778761.713544:0:6928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778761.713546:0:6928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778761.713547:0:6928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778761.713548:0:6928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778761.713549:0:6928:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778761.713551:0:6928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778761.713552:0:6928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778761.713553:0:6928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778761.713554:0:6928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790778761.713593:0:6928:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790778761.713624:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531533312:0@lo:253: 00000100:00100000:0.0:1790778761.713742:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778761.713934:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e180 going to sleep for 11 seconds 00000100:00100000:3.0:1790778761.714013:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533312 00000100:00100000:3.0:1790778761.714024:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533312 00000100:00100000:3.0:1790778761.714120:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790778761.714132:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531533312:12345-0@lo:253: 20000000:01000000:3.0:1790778761.714173:0:5944:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790778761.714177:0:5944:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790778761.714189:0:5944:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790778761.714191:0:5944:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790778761.715312:0:5944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778761.715458:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790778761.715474:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790778761.715493:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790778761.715498:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790778761.715512:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790778761.715528:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790778761.715746:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790778761.715762:0:5944:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:3.0:1790778761.715764:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:3.0:1790778761.715783:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790778761.715790:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790778761.715800:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790778761.715804:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:3.0:1790778761.715811:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790778761.715815:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790778761.715834:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790778761.715844:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1790778761.716170:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790778761.716178:0:5944:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:3.0:1790778761.716179:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:3.0:1790778761.716187:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790778761.716190:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790778761.716197:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790778761.716200:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:3.0:1790778761.716220:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790778761.716224:0:5944:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790778761.716233:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790778761.716241:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790778761.716250:0:5944:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790778761.716257:0:5944:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790778761.716261:0:5944:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790778761.716305:0:5944:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790778761.716307:0:5944:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778761.716865:0:6947:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778761.716890:0:6947:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778761.716904:0:6947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790778761.717112:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1790778761.717136:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1790778761.717152:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1790778761.717163:0:5944:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790778761.717165:0:5944:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790778761.717907:0:6948:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790778761.717949:0:6948:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790778761.717964:0:6948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790778761.718154:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790778761.718172:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790778761.718188:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790778761.718195:0:5944:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790778761.718196:0:5944:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790778761.720092:0:6949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790778761.720494:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790778761.720530:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790778761.720543:0:5944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1790778761.720561:0:5944:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790778761.720589:0:5944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.720614:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074594 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.720622:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560745b0 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.720629:0:5944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074620 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.720638:0:5944:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.720687:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074620 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.720704:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074620 expref: 12 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.720722:0:5944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1877767531533440:0@lo:104: 00000100:00100000:0.0:1790778761.720984:0:5944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778761.721158:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560745b0 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.721184:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560745b0 expref: 12 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.721194:0:5944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330eed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1877767531533568:0@lo:104: 00000100:00100000:0.0:1790778761.721231:0:5944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778761.729483:0:5944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074594 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.729510:0:5944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074594 expref: 12 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.729530:0:5944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1877767531533696:0@lo:104: 00000100:00100000:0.0:1790778761.729620:0:5944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778761.730933:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533440 00000100:00100000:3.0:1790778761.730948:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533440 00000100:00100000:2.0:1790778761.732210:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533568 00000100:00100000:2.0:1790778761.732223:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533568 00000100:00100000:2.0:1790778761.732253:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778761.732268:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+4:5944:x1877767531533440:12345-0@lo:104: 00010000:00010000:2.0:1790778761.732291:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.732422:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778761.732429:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+4:5944:x1877767531533440:12345-0@lo:104: Request processed in 167us (11446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.732437:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778761.732480:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778761.732488:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5944:x1877767531533568:12345-0@lo:104: 00010000:00010000:2.0:1790778761.732497:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.732532:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790778761.732538:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5944:x1877767531533568:12345-0@lo:104: Request processed in 52us (11306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.732544:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790778761.732610:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790778761.732619:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.732627:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778761.732632:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.732642:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778761.732649:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778761.732655:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778761.732701:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.732727:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778761.732817:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778761.734630:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.734648:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef200031400/0xdc87632656074620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074627 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.734678:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778761.734681:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778761.734683:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778761.734712:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778761.734736:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531533824:0@lo:103: 00000100:00100000:3.0:1790778761.734815:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778761.734885:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533824 00000100:00100000:3.0:1790778761.734894:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533824 00010000:00010000:3.0:1790778761.734931:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074620 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778761.734962:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778761.734970:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+13:3440:x1877767531533824:12345-0@lo:103: 00010000:00010000:3.0:1790778761.734986:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778761.734992:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074620 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.735005:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074620 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.735166:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778761.735207:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+13:3440:x1877767531533824:12345-0@lo:103: Request processed in 237us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.735233:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778761.736970:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531533824:0@lo:103: 00010000:00010000:3.0:1790778761.739922:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778761.739930:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778761.739933:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778761.739963:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.739979:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aac00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790778761.739985:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.740021:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778761.740031:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778761.740037:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778761.740136:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.740145:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778761.740183:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.740191:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560745b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560745b7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.740208:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778761.740210:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778761.740212:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778761.740221:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778761.740243:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531533952:0@lo:103: 00000100:00100000:2.0:1790778761.740335:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.740561:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533952 00000100:00100000:1.0:1790778761.740573:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533952 00010000:00010000:1.0:1790778761.740607:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560745b0 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.740656:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790778761.740667:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+13:3439:x1877767531533952:12345-0@lo:103: 00010000:00010000:1.0:1790778761.740702:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778761.740709:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560745b0 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.740722:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560745b0 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.740744:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778761.740960:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+13:3439:x1877767531533952:12345-0@lo:103: Request processed in 294us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778761.740969:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778761.741069:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531533952:0@lo:103: 00000100:00100000:2.0:1790778761.741866:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531533696 00000100:00100000:2.0:1790778761.741875:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531533696 00000100:00100000:2.0:1790778761.741923:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790778761.741933:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5944:x1877767531533696:12345-0@lo:104: 00010000:00010000:2.0:1790778761.741961:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742022:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790778761.742030:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5944:x1877767531533696:12345-0@lo:104: Request processed in 99us (12410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.742038:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790778761.742059:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778761.742065:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742073:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790778761.742085:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742095:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778761.742103:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778761.742109:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790778761.742141:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742148:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790778761.742171:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742179:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc87632656074594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607459b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742204:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778761.742207:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778761.742209:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778761.742227:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531534080:0@lo:103: 00000100:00100000:2.0:1790778761.742267:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778761.742334:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534080 00000100:00100000:2.0:1790778761.742338:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534080 00010000:00010000:2.0:1790778761.742354:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074594 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778761.742390:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790778761.742399:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+13:3441:x1877767531534080:12345-0@lo:103: 00010000:00010000:2.0:1790778761.742410:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778761.742415:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074594 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742426:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074594 expref: 13 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742462:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742472:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742489:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742497:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742510:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742517:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742523:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778761.742527:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742536:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742545:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.742558:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778761.742592:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+13:3441:x1877767531534080:12345-0@lo:103: Request processed in 194us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.742598:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790778761.742642:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531534080:0@lo:103: 00000100:00100000:0.0:1790778761.742749:0:5944:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e840 going to sleep for 11 seconds 00010000:00010000:0.0:1790778761.742771:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499c00/0xdc87632656074627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074620 expref: 12 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.742797:0:5944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1877767531533440:0@lo:104: 00010000:00010000:0.0:1790778761.742810:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201498000/0xdc876326560745b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560745b0 expref: 11 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.742834:0:5944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330eed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1877767531533568:0@lo:104: 00010000:00010000:0.0:1790778761.742843:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499e00/0xdc8763265607459b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074594 expref: 10 pid: 5943 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.742852:0:5944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5944:1877767531533696:0@lo:104: 00010000:00010000:0.0:1790778761.742874:0:5944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.742891:0:5944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.742898:0:5944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.742905:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef200030c00/0xdc87632656074682 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790778761.742995:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790778761.746470:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+9:6928:x1877767531533312:12345-0@lo:253: Request processed in 32299us (32687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.746490:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790778761.746867:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531533312:0@lo:253: 10000000:01000000:0.0:1790778761.747018:0:6928:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790778761.747022:0:6928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790778761.747024:0:6928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790778761.747025:0:6928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778761.747027:0:6928:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790778761.747028:0:6928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778761.747030:0:6928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778761.747032:0:6928:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778761.747033:0:6928:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790778761.747036:0:6928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778761.747037:0:6928:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790778761.747094:0:6928:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef2332da000 from lustre-OST0000 10000000:01000000:0.0:1790778761.747138:0:6928:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790778761.747142:0:6928:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790778761.747152:0:6928:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef2201619c0 local copy 10000000:01000000:0.0:1790778761.747158:0:6928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790778761.747204:0:6928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.747223:0:6928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.747261:0:6928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.747283:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534208:0@lo:101: 00000100:00100000:0.0:1790778761.747333:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778761.747437:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778761.747745:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534208 00000100:00100000:3.0:1790778761.747756:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534208 00000100:00100000:2.0:1790778761.747986:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790778761.747999:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+9:6928:x1877767531534208:12345-0@lo:101: 00010000:00010000:2.0:1790778761.748018:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778761.748037:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165a600/0xdc87632656074690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074689 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.748067:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165a600/0xdc87632656074690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074689 expref: 10 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.748092:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165a600/0xdc87632656074690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074689 expref: 10 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.748102:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165a600, rc 0) 00000100:00100000:2.0:1790778761.748163:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+10:6928:x1877767531534208:12345-0@lo:101: Request processed in 167us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.748170:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790778761.748250:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534208:0@lo:101: 00010000:00010000:1.0:1790778761.748266:0:6928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.748276:0:6928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.748427:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534336:0@lo:501: 00000100:00100000:1.0:1790778761.748496:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.748695:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778761.748811:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534336 00000100:00100000:0.0:1790778761.748817:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534336 00000100:00100000:0.0:1790778761.748844:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790778761.748851:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+10:6928:x1877767531534336:12345-0@lo:501: 00000100:00100000:0.0:1790778761.748926:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+10:6928:x1877767531534336:12345-0@lo:501: Request processed in 75us (429us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778761.748933:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790778761.749059:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534336:0@lo:501: 10000000:01000000:1.0:1790778761.749076:0:6928:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790778761.749096:0:6928:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790778761.749102:0:6928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.749111:0:6928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.749119:0:6928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.749144:0:6928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790778761.749170:0:6928:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef2332da000 10000000:01000000:1.0:1790778761.749175:0:6928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790778761.749180:0:6928:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ef2201619c0 10000000:01000000:1.0:1790778761.749182:0:6928:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790778761.749186:0:6928:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ef2201619c0 from 1 10000000:01000000:1.0:1790778761.749189:0:6928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790778761.749223:0:6928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.749232:0:6928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.749242:0:6928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.749256:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534464:0@lo:101: 00000100:00100000:1.0:1790778761.749287:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.749300:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778761.749342:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534464 00000100:00100000:0.0:1790778761.749346:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534464 00000100:00100000:0.0:1790778761.749363:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790778761.749369:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+10:6928:x1877767531534464:12345-0@lo:101: 00010000:00010000:0.0:1790778761.749387:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778761.749413:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a1e00/0xdc8763265607469e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074697 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749431:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a1e00/0xdc8763265607469e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074697 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749588:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a1e00/0xdc8763265607469e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074697 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749598:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1e00, rc 0) 00000100:00100000:0.0:1790778761.749801:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531534464:12345-0@lo:101: Request processed in 431us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.749808:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1790778761.749835:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778761.749842:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749850:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031c00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778761.749854:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749863:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778761.749870:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778761.749875:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778761.749897:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749903:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778761.749934:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.749941:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef200031c00/0xdc87632656074689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdc87632656074690 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778761.749963:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778761.749977:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531534592:0@lo:103: 00000100:00100000:0.0:1790778761.750009:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778761.750063:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534592 00000100:00100000:0.0:1790778761.750068:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534592 00000100:00100000:0.0:1790778761.750104:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778761.750113:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+11:3441:x1877767531534592:12345-0@lo:103: 00010000:00010000:0.0:1790778761.750123:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778761.750136:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165a600/0xdc87632656074690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc87632656074689 expref: 11 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.750149:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778761.750175:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+10:3441:x1877767531534592:12345-0@lo:103: Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.750182:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778761.750214:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531534592:0@lo:103: 00010000:00010000:0.0:1790778761.750228:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778761.750230:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778761.750232:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778761.750753:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534464:0@lo:101: 00010000:00010000:1.0:1790778761.750780:0:6928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.750790:0:6928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778761.750808:0:6928:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790778761.750826:0:6928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.750835:0:6928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778761.750844:0:6928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790778761.750851:0:6928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790778761.750857:0:6928:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790778761.750860:0:6928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790778761.750891:0:6928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.750899:0:6928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.750909:0:6928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.750924:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534720:0@lo:101: 00000100:00100000:1.0:1790778761.750957:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.750985:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778761.751170:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534720 00000100:00100000:3.0:1790778761.751177:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534720 00000100:00100000:3.0:1790778761.751221:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778761.751232:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+10:6928:x1877767531534720:12345-0@lo:101: 00010000:00010000:3.0:1790778761.751246:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778761.751258:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560746a5 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.751278:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560746a5 expref: 11 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.751288:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746a5 expref: 11 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.751295:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201498c00, rc 0) 00000100:00100000:3.0:1790778761.751340:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531534720:12345-0@lo:101: Request processed in 109us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.751347:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790778761.751481:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534720:0@lo:101: 00010000:00010000:1.0:1790778761.751493:0:6928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.751501:0:6928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.751758:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534848:0@lo:501: 00000100:00100000:1.0:1790778761.751854:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.751889:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778761.751974:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534848 00000100:00100000:3.0:1790778761.751980:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534848 00000100:00100000:3.0:1790778761.752058:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790778761.752067:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531534848:12345-0@lo:501: 00000100:00100000:3.0:1790778761.752203:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531534848:12345-0@lo:501: Request processed in 137us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.752211:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790778761.752271:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534848:0@lo:501: 00000100:00100000:1.0:1790778761.752302:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534976:0@lo:503: 00000100:00100000:1.0:1790778761.752342:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.752671:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778761.752740:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531534976 00000100:00100000:2.0:1790778761.752746:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531534976 00000100:00100000:2.0:1790778761.752786:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790778761.752794:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531534976:12345-0@lo:503: 00000100:00100000:2.0:1790778761.752924:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531534976:12345-0@lo:503: Request processed in 130us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.752932:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790778761.753119:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531534976:0@lo:503: 00000040:00080000:1.0:1790778761.753484:0:6928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790778761.753573:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535104:0@lo:502: 00000100:00100000:1.0:1790778761.753620:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.753650:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778761.753710:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535104 00000100:00100000:0.0:1790778761.753717:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535104 00000100:00100000:0.0:1790778761.753752:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790778761.753760:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531535104:12345-0@lo:502: 00000100:00100000:0.0:1790778761.753873:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531535104:12345-0@lo:502: Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.753880:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790778761.754017:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535104:0@lo:502: 00000040:00080000:1.0:1790778761.754277:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790778761.754306:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790778761.754322:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790778761.754338:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790778761.754353:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790778761.754368:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790778761.754416:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535232:0@lo:502: 00000100:00100000:1.0:1790778761.754487:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.754524:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778761.754595:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535232 00000100:00100000:2.0:1790778761.754601:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535232 00000100:00100000:2.0:1790778761.754745:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790778761.754753:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531535232:12345-0@lo:502: 00000100:00100000:2.0:1790778761.754861:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531535232:12345-0@lo:502: Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.754869:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790778761.755062:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535232:0@lo:502: 00000040:00080000:1.0:1790778761.755107:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790778761.755117:0:6928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1790778761.755834:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790778761.755846:0:6952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790778761.755855:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778761.755858:0:6952:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790778761.755865:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778761.755887:0:6952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ef2331e4d40) 00000020:00000080:0.0:1790778761.755919:0:6952:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790778761.755928:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790778761.756597:0:6952:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef2332da000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790778761.756612:0:6952:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790778761.756624:0:6952:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdc876326560746ba 00010000:00010000:2.0:1790778761.774570:0:6952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1790778761.775358:0:6952:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790778761.779598:0:6952:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790778761.780123:0:6952:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790778761.800611:0:6952:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1790778761.800969:0:6952:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1790778761.817926:0:6952:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1790778761.824390:0:6952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790778761.824409:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778761.824417:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778761.824420:0:6952:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790778761.824425:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778761.824431:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778761.824432:0:6952:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790778761.824436:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790778761.824439:0:6952:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790778761.824928:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778761.824933:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778761.824934:0:6952:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790778761.824938:0:6952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790778761.828481:0:6928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1790778761.828540:0:6928:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790778761.828561:0:6928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.828578:0:6928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778761.828588:0:6928:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef2332da000 from 1 10000000:01000000:1.0:1790778761.828592:0:6928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778761.828646:0:6928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.828671:0:6928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.828685:0:6928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.828716:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535360:0@lo:101: 00000100:00100000:1.0:1790778761.828969:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.829040:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778761.829125:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535360 00000100:00100000:2.0:1790778761.829134:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535360 00000100:00100000:2.0:1790778761.829205:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790778761.829216:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+11:6928:x1877767531535360:12345-0@lo:101: 00010000:00010000:2.0:1790778761.829233:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778761.829248:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560746c1 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.829278:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560746c1 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.829289:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746c1 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.829299:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165a000, rc 0) 00000100:00100000:2.0:1790778761.829345:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535360:12345-0@lo:101: Request processed in 132us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.829352:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790778761.829678:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535360:0@lo:101: 00010000:00010000:1.0:1790778761.829698:0:6928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.829709:0:6928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.830021:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535488:0@lo:501: 00000100:00100000:1.0:1790778761.830059:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.830108:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778761.830330:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535488 00000100:00100000:2.0:1790778761.830337:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535488 00000100:00100000:2.0:1790778761.830391:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790778761.830400:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535488:12345-0@lo:501: 00000100:00100000:2.0:1790778761.830587:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535488:12345-0@lo:501: Request processed in 188us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778761.830594:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790778761.830738:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535488:0@lo:501: 00000100:00100000:1.0:1790778761.830881:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535616:0@lo:503: 00000100:00100000:1.0:1790778761.830938:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.830980:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778761.831079:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535616 00000100:00100000:0.0:1790778761.831085:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535616 00000100:00100000:0.0:1790778761.831130:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778761.831139:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535616:12345-0@lo:503: 00000100:00100000:0.0:1790778761.831304:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535616:12345-0@lo:503: Request processed in 166us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.831313:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790778761.831419:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535616:0@lo:503: 00000040:00080000:1.0:1790778761.831962:0:6928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790778761.832062:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535744:0@lo:502: 00000100:00100000:1.0:1790778761.832109:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.832148:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778761.832282:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535744 00000100:00100000:0.0:1790778761.832289:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535744 00000100:00100000:0.0:1790778761.832320:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790778761.832327:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535744:12345-0@lo:502: 00000100:00100000:0.0:1790778761.832564:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535744:12345-0@lo:502: Request processed in 236us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.832573:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790778761.832757:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535744:0@lo:502: 00000040:00080000:1.0:1790778761.833985:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790778761.834033:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790778761.834078:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535872:0@lo:502: 00000100:00100000:1.0:1790778761.834146:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.837525:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790778761.838152:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531535872 00000100:00100000:2.0:1790778761.838226:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531535872 00000100:00100000:2.0:1790778761.838349:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790778761.838373:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535872:12345-0@lo:502: 00000100:00100000:0.0:1790778761.839342:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531535872:12345-0@lo:502: Request processed in 963us (5187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.839356:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790778761.839519:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531535872:0@lo:502: 00000040:00080000:1.0:1790778761.839692:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790778761.839711:0:6928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790778761.843058:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778761.843081:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778761.843084:0:6956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790778761.843093:0:6956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef2332da000 00000020:00000080:0.0:1790778761.843096:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790778761.843111:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778761.843116:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778761.843118:0:6956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790778761.843121:0:6956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790778761.843374:0:6928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790778761.843418:0:6928:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790778761.843485:0:6928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.843503:0:6928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778761.843573:0:6928:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790778761.843576:0:6928:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef2332da000 10000000:01000000:2.0:1790778761.843580:0:6928:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef2332da000 10000000:01000000:2.0:1790778761.843584:0:6928:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790778761.843591:0:6928:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef2332da000 from 1 10000000:01000000:2.0:1790778761.843594:0:6928:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790778761.843647:0:6928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.843657:0:6928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778761.843672:0:6928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778761.843707:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536000:0@lo:101: 00000100:00100000:2.0:1790778761.843825:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778761.843882:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2333690c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778761.844064:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536000 00000100:00100000:1.0:1790778761.844075:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536000 00000100:00100000:1.0:1790778761.844137:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790778761.844147:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:6928:x1877767531536000:12345-0@lo:101: 00010000:00010000:1.0:1790778761.844173:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778761.844191:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560746cf expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.844220:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560746cf expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.844231:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746cf expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.844241:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:1.0:1790778761.844289:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536000:12345-0@lo:101: Request processed in 143us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778761.844303:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790778761.844353:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536000:0@lo:101: 00010000:00010000:1.0:1790778761.844369:0:6928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778761.844726:0:6928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778761.844914:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536128:0@lo:501: 00000100:00100000:1.0:1790778761.844952:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.845029:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d900 going to sleep for 11 seconds 00000100:00100000:0.0:1790778761.851404:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536128 00000100:00100000:0.0:1790778761.851426:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536128 00000100:00100000:0.0:1790778761.851526:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790778761.851537:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536128:12345-0@lo:501: 00000100:00100000:0.0:1790778761.852092:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536128:12345-0@lo:501: Request processed in 555us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.852101:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778761.852975:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536128:0@lo:501: 00000100:00100000:1.0:1790778761.853057:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536256:0@lo:503: 00000100:00100000:1.0:1790778761.853135:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778761.853247:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d900 going to sleep for 11 seconds 00000100:00100000:2.0:1790778761.854914:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536256 00000100:00100000:2.0:1790778761.854932:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536256 00000100:00100000:3.0:1790778761.858726:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790778761.858745:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536256:12345-0@lo:503: 00000100:00100000:3.0:1790778761.859882:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536256:12345-0@lo:503: Request processed in 1135us (6740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.859895:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790778761.861151:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536256:0@lo:503: 00000040:00080000:2.0:1790778761.862011:0:6928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778761.862310:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536384:0@lo:502: 00000100:00100000:2.0:1790778761.862431:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778761.863018:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778761.863116:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536384 00000100:00100000:3.0:1790778761.863127:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536384 00000100:00100000:3.0:1790778761.863354:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790778761.863369:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536384:12345-0@lo:502: 00000100:00100000:0.0:1790778761.864054:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536384:12345-0@lo:502: Request processed in 686us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.864065:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790778761.864337:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536384:0@lo:502: 00000040:00080000:2.0:1790778761.864705:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790778761.864758:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790778761.865045:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790778761.865066:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790778761.865081:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1790778761.865096:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1790778761.865111:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1790778761.865123:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1790778761.865135:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1790778761.865148:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1790778761.865284:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1790778761.865304:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1790778761.865319:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1790778761.865334:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1790778761.865348:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1790778761.865361:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1790778761.865385:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1790778761.865419:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1790778761.865434:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1790778761.865749:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1790778761.866061:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1790778761.866087:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1790778761.866103:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1790778761.866118:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1790778761.866132:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1790778761.866156:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1790778761.866331:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1790778761.866348:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1790778761.866426:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536512:0@lo:502: 00000100:00100000:2.0:1790778761.866556:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778761.866642:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778761.866912:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536512 00000100:00100000:1.0:1790778761.866924:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536512 00000100:00100000:1.0:1790778761.866988:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778761.866999:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536512:12345-0@lo:502: 00000100:00100000:1.0:1790778761.867169:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536512:12345-0@lo:502: Request processed in 161us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778761.867178:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790778761.867928:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536512:0@lo:502: 00000040:00080000:2.0:1790778761.868010:0:6928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1790778761.868023:0:6928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1790778761.869504:0:6957:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790778761.869528:0:6957:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ef23b9a19c0) 00000020:00000080:2.0:1790778761.869558:0:6957:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1790778761.869687:0:6957:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef2332da000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790778761.869691:0:6957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef2332da000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790778761.869694:0:6957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef2332da000 3 00010000:00080000:2.0:1790778761.869740:0:6957:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef235b09800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1790778761.875701:0:6957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1790778761.876091:0:6957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790778761.876148:0:6957:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790778761.876179:0:6957:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdc876326560746e4 00000100:00080000:2.0:1790778761.876195:0:6957:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790778761.876335:0:6957:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ef235b09800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778761.876398:0:6957:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2201adf80 x1877767531536640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790778761.876460:0:6957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790778761.876639:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531536640:0@lo:38: 00000100:00100000:0.0:1790778761.876745:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778761.877280:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536640 00000100:00100000:2.0:1790778761.877291:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536640 00000100:00100000:2.0:1790778761.877339:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778761.877348:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531536640:12345-0@lo:38: 00010000:00080000:2.0:1790778761.877400:0:5949:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1790778761.877492:0:5949:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdc876326560746eb 00000004:00100000:1.0:1790778761.877529:0:5949:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790778761.877574:0:5949:0:(import.c:65:import_set_state_nolock()) ffff9ef23586c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778761.877655:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3438:x1877767531536640:12345-0@lo:38: Request processed in 306us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778761.877672:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1790778761.877718:0:6957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:1.0:1790778761.877723:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef2201adf80 x1877767531536640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778761.877734:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790778761.877743:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790778761.877751:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790778761.877772:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790778761.877774:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790778761.877782:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531536640:0@lo:38: 00000020:01000000:0.0:1790778761.877855:0:6928:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790778761.877889:0:6928:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790778761.877913:0:6928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778761.877926:0:6928:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790778761.877982:0:6928:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790778761.877985:0:6928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790778761.877987:0:6928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778761.877988:0:6928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778761.877989:0:6928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778761.877991:0:6928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778761.877997:0:6928:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778761.877998:0:6928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778761.878000:0:6928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778761.878002:0:6928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778761.878004:0:6928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790778761.878009:0:6928:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790778761.878012:0:6928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790778761.878013:0:6928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790778761.878014:0:6928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778761.878015:0:6928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778761.878016:0:6928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778761.878017:0:6928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778761.878018:0:6928:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778761.878019:0:6928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778761.878020:0:6928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778761.878021:0:6928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778761.878022:0:6928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790778761.878044:0:6928:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790778761.878060:0:6928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536768:0@lo:253: 00000100:00100000:0.0:1790778761.878117:0:6928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778761.878170:0:6928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233206a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778761.878181:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536768 00000100:00100000:1.0:1790778761.878187:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536768 00000100:00100000:1.0:1790778761.878230:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790778761.878239:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536768:12345-0@lo:253: 20000000:01000000:1.0:1790778761.878265:0:5942:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790778761.878283:0:5942:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790778761.887150:0:5942:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790778761.887187:0:5942:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790778761.887236:0:5965:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790778761.887242:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790778761.887276:0:5965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887301:0:5965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607464a expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887311:0:5965:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887366:0:5965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607464a expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887398:0:5965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607464a expref: 13 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778761.887416:0:5965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1877767531536896:0@lo:104: 00000100:00100000:3.0:1790778761.887490:0:5965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778761.887514:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:6928:x1877767531536768:12345-0@lo:253: Request processed in 9275us (9396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778761.887527:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790778761.887542:0:5965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bad480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778761.887567:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531536896 00000100:00100000:3.0:1790778761.887577:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531536896 00000100:00100000:3.0:1790778761.887630:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790778761.887640:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5965:x1877767531536896:12345-0@lo:104: 00010000:00010000:3.0:1790778761.887654:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887703:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790778761.887709:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:5965:x1877767531536896:12345-0@lo:104: Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.887714:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790778761.887739:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778761.887751:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887760:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030000 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778761.887764:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887775:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778761.887783:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778761.887790:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790778761.887824:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887831:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778761.887857:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887865:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc8763265607464a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074651 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.887888:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778761.887891:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778761.887894:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778761.887898:0:6928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:6928:1877767531536768:0@lo:253: 10000000:01000000:0.0:1790778761.887926:0:6928:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:3.0:1790778761.887931:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531537024:0@lo:103: 00000020:01000004:0.0:1790778761.887933:0:6928:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790778761.887939:0:6928:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790778761.887943:0:6928:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778761.887945:0:6928:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778761.887947:0:6928:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778761.887950:0:6928:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778761.887952:0:6928:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778761.887955:0:6928:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778761.887972:0:6928:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778761.887975:0:6928:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778761.887978:0:6928:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1790778761.887985:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:0.0:1790778761.888009:0:6928:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790778761.888040:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537024 00000100:00100000:3.0:1790778761.888046:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537024 00010000:00010000:3.0:1790778761.888071:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607464a expref: 13 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778761.888096:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790778761.888103:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+13:3439:x1877767531537024:12345-0@lo:103: 00010000:00010000:3.0:1790778761.888115:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778761.888121:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607464a expref: 13 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888131:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607464a expref: 13 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888149:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888157:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790778761.888170:0:5934:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001748446s 00010000:00010000:3.0:1790778761.888175:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888182:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888189:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888195:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888201:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201499600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778761.888211:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888219:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888229:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888238:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778761.888265:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+13:3439:x1877767531537024:12345-0@lo:103: Request processed in 162us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778761.888271:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790778761.888332:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531537024:0@lo:103: 00010000:00010000:3.0:1790778761.888356:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef200030600/0xdc87632656074651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607464a expref: 12 pid: 5944 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778761.888366:0:5965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1877767531536896:0@lo:104: 00010000:00010000:3.0:1790778761.888390:0:5965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888400:0:5965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888406:0:5965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778761.888411:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499600/0xdc876326560746f2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1790778761.893540:0:6928:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1790778761.893706:0:6928:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1790778761.893927:0:6928:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1790778761.894083:0:6928:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1790778761.894313:0:6928:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1790778761.894609:0:6928:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1790778761.904960:0:6928:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790778761.936749:0:6928:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790778761.936975:0:6928:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790778761.937029:0:6928:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790778761.937167:0:6928:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790778761.937193:0:6928:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790778761.937227:0:6928:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790778761.938912:0:6928:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778761.939201:0:6928:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1790778761.998851:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778762.930497:0:7011:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778762.930694:0:7011:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790778763.021565:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778764.043689:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778765.083070:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790778765.195505:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790778765.195513:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef211145000 from 21 10000000:01000000:3.0:1790778765.195518:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778765.195564:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.195576:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.195588:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778765.195613:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537152:0@lo:101: 00000100:00100000:3.0:1790778765.195690:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.195782:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220b756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778765.196176:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537152 00000100:00100000:1.0:1790778765.196190:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537152 00000100:00100000:1.0:1790778765.196274:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790778765.196304:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531537152:12345-0@lo:101: 00010000:00010000:1.0:1790778765.196323:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778765.196341:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560746f9 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.196380:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560746f9 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.196390:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746f9 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.196398:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:1.0:1790778765.196469:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531537152:12345-0@lo:101: Request processed in 171us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.196476:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790778765.196527:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537152:0@lo:101: 00010000:00010000:1.0:1790778765.196549:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.196559:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778765.196629:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537280:0@lo:501: 00000100:00100000:1.0:1790778765.196657:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778765.196675:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20321e900 going to sleep for 11 seconds 00000100:00100000:1.0:1790778765.196709:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537280 00000100:00100000:1.0:1790778765.196716:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537280 00000100:00100000:1.0:1790778765.196976:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790778765.196988:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531537280:12345-0@lo:501: 00000100:00100000:1.0:1790778765.199413:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531537280:12345-0@lo:501: Request processed in 2420us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.199427:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790778765.199996:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537280:0@lo:501: 00000100:00100000:3.0:1790778765.200065:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537408:0@lo:503: 00000100:00100000:3.0:1790778765.200117:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.200156:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220b75000 going to sleep for 11 seconds 00000100:00100000:3.0:1790778765.200173:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537408 00000100:00100000:3.0:1790778765.200180:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537408 00000100:00100000:3.0:1790778765.200219:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790778765.200227:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531537408:12345-0@lo:503: 00000100:00100000:3.0:1790778765.200326:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531537408:12345-0@lo:503: Request processed in 99us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778765.200335:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790778765.200393:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537408:0@lo:503: 00000100:00100000:3.0:1790778765.214917:0:7112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7112:1877767531537536:0@lo:502: 00000100:00100000:3.0:1790778765.215045:0:7112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.215093:0:7112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220b75000 going to sleep for 11 seconds 00000100:00100000:1.0:1790778765.216822:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537536 00000100:00100000:1.0:1790778765.216836:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537536 00000100:00100000:1.0:1790778765.216890:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790778765.216900:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:7112:x1877767531537536:12345-0@lo:502: 00000100:00100000:1.0:1790778765.217892:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:7112:x1877767531537536:12345-0@lo:502: Request processed in 989us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.217906:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790778765.218183:0:7112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7112:1877767531537536:0@lo:502: 00000100:00100000:3.0:1790778765.218277:0:7112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7112:1877767531537664:0@lo:502: 00000100:00100000:3.0:1790778765.218357:0:7112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.218408:0:7112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220b75000 going to sleep for 11 seconds 00000100:00100000:1.0:1790778765.218474:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537664 00000100:00100000:1.0:1790778765.218480:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537664 00000100:00100000:1.0:1790778765.218517:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790778765.218525:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:7112:x1877767531537664:12345-0@lo:502: 00000100:00100000:1.0:1790778765.218613:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:7112:x1877767531537664:12345-0@lo:502: Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.218620:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790778765.218763:0:7112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7112:1877767531537664:0@lo:502: 00000040:00080000:3.0:1790778765.218782:0:7112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790778765.222103:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790778765.222145:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778765.222157:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.222171:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778765.222184:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790778765.222187:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef211145000 from 4 10000000:01000000:1.0:1790778765.222190:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790778765.222248:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.222257:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778765.222268:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778765.222292:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537792:0@lo:101: 00000100:00100000:1.0:1790778765.222370:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778765.222429:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20321e000 going to sleep for 11 seconds 00000100:00100000:3.0:1790778765.222972:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537792 00000100:00100000:3.0:1790778765.222982:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537792 00000100:00100000:3.0:1790778765.223032:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778765.223041:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531537792:12345-0@lo:101: 00010000:00010000:3.0:1790778765.223055:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778765.223072:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074707 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223095:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223106:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223114:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201498200, rc 0) 00000100:00100000:3.0:1790778765.223163:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531537792:12345-0@lo:101: Request processed in 122us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778765.223169:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790778765.223214:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537792:0@lo:101: 00010000:00010000:3.0:1790778765.223236:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223245:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778765.223290:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537920:0@lo:256: 00000100:00100000:3.0:1790778765.223321:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.223333:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220b75c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778765.223355:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531537920 00000100:00100000:3.0:1790778765.223360:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531537920 00000100:00100000:3.0:1790778765.223382:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778765.223388:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531537920:12345-0@lo:256: 20000000:01000000:3.0:1790778765.223413:0:5944:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790778765.223430:0:5944:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790778765.223433:0:5944:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790778765.223524:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531537920:12345-0@lo:256: Request processed in 136us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778765.223530:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778765.223559:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531537920:0@lo:256: 10000000:01000000:3.0:1790778765.223599:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790778765.223605:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223613:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778765.223621:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790778765.223628:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790778765.223632:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790778765.223650:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223659:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223667:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778765.223679:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531538048:0@lo:101: 00000100:00100000:3.0:1790778765.223704:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.223718:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778765.223729:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538048 00000100:00100000:3.0:1790778765.223732:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538048 00000100:00100000:3.0:1790778765.223767:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790778765.223774:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531538048:12345-0@lo:101: 00010000:00010000:3.0:1790778765.223781:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778765.223790:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074715 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223803:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074715 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223813:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074715 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223819:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201499e00, rc 0) 00000100:00100000:3.0:1790778765.223845:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531538048:12345-0@lo:101: Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778765.223858:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790778765.223888:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531538048:0@lo:101: 00010000:00010000:3.0:1790778765.223898:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778765.223905:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778765.223957:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531538176:0@lo:501: 00000100:00100000:3.0:1790778765.223980:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.223991:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778765.224000:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538176 00000100:00100000:3.0:1790778765.224003:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538176 00000100:00100000:3.0:1790778765.224021:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790778765.224026:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531538176:12345-0@lo:501: 00000100:00100000:3.0:1790778765.224129:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531538176:12345-0@lo:501: Request processed in 101us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778765.224136:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790778765.224164:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531538176:0@lo:501: 00000100:00100000:3.0:1790778765.224190:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531538304:0@lo:503: 00000100:00100000:3.0:1790778765.224231:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.224243:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778765.224254:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538304 00000100:00100000:3.0:1790778765.224257:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538304 00000100:00100000:3.0:1790778765.224277:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790778765.224283:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531538304:12345-0@lo:503: 00000100:00100000:3.0:1790778765.224382:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531538304:12345-0@lo:503: Request processed in 99us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778765.224389:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790778765.224426:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531538304:0@lo:503: 00000100:00100000:0.0:1790778765.225834:0:7113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7113:1877767531538432:0@lo:502: 00000100:00100000:0.0:1790778765.225901:0:7113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778765.225945:0:7113:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cad180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778765.226115:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538432 00000100:00100000:1.0:1790778765.226121:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538432 00000100:00100000:1.0:1790778765.226167:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790778765.226174:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:7113:x1877767531538432:12345-0@lo:502: 00000100:00100000:1.0:1790778765.226293:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:7113:x1877767531538432:12345-0@lo:502: Request processed in 119us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.226300:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790778765.226393:0:7113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7113:1877767531538432:0@lo:502: 00000020:01000000:0.0:1790778765.226416:0:7113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790778765.226423:0:7113:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790778765.226431:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778765.226434:0:7113:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790778765.226518:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790778765.226523:0:7113:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:0.0:1790778765.226547:0:7113:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790778765.226550:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778765.226565:0:7113:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ef2331e3380) 00000020:00000080:0.0:1790778765.226585:0:7113:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1790778765.226592:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790778765.226676:0:7113:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790778765.226681:0:7113:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790778765.226687:0:7113:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc8763265607472a 00010000:00080000:0.0:1790778765.226717:0:7113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef23333c000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1790778765.233915:0:7113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790778765.256869:0:7113:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790778765.256897:0:7113:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790778765.257291:0:7113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778765.257728:0:7113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778765.257806:0:7113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790778765.257875:0:7113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1790778765.259183:0:7116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790778765.259188:0:7116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790778765.264389:0:7113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790778765.264410:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790778765.264504:0:7113:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790778765.264527:0:7113:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656074731 00000100:00080000:1.0:1790778765.264538:0:7113:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790778765.264550:0:7113:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef23333c000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1790778765.264586:0:7113:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef206d77b80 x1877767531538560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790778765.264610:0:7113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790778765.264688:0:7113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778765.264706:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778765.264709:0:7113:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790778765.264715:0:7113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778765.264720:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778765.264722:0:7113:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790778765.264726:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790778765.264728:0:7113:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790778765.264768:0:7113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7113:1877767531538688:0@lo:502: 00000100:00100000:1.0:1790778765.264855:0:7113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778765.264907:0:7113:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20321e900 going to sleep for 11 seconds 00000100:00100000:0.0:1790778765.265023:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531538560:0@lo:8: 00000100:00100000:0.0:1790778765.265233:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778765.265306:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538688 00000100:00100000:0.0:1790778765.265316:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538688 00000100:00100000:0.0:1790778765.265376:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790778765.265389:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:7113:x1877767531538688:12345-0@lo:502: 00000100:00100000:0.0:1790778765.265554:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:7113:x1877767531538688:12345-0@lo:502: Request processed in 168us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778765.265562:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790778765.265674:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538560 00000100:00100000:1.0:1790778765.265681:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538560 00000100:00100000:1.0:1790778765.265726:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790778765.265734:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3438:x1877767531538560:12345-0@lo:8: 00010000:00080000:1.0:1790778765.265760:0:6934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1790778765.265792:0:6934:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656074738 00002000:00100000:1.0:1790778765.265830:0:6934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ef23586f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790778765.265835:0:6934:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1790778765.265838:0:6934:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790778765.265906:0:6934:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790778765.267484:0:6934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790778765.267857:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef23586a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778765.267991:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3438:x1877767531538560:12345-0@lo:8: Request processed in 2253us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.268003:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790778765.268179:0:7113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:7113:1877767531538688:0@lo:502: 00000020:01000000:1.0:1790778765.268231:0:7113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778765.268242:0:7113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778765.268255:0:7113:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790778765.268263:0:7113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:0.0:1790778765.268506:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d77b80 x1877767531538560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790778775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778765.268519:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790778765.268528:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790778765.268537:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790778765.268544:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790778765.268546:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef23333c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790778765.268569:0:3438:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790778765.268574:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531538560:0@lo:8: 00000004:00080000:3.0:1790778765.269673:0:7116:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790778765.270225:0:7116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 159145781402ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790778765.270234:0:7116:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1790778765.270645:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778765.270668:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531538816:0@lo:400: 00000100:00100000:0.0:1790778765.270744:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778765.270797:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531538944:0@lo:400: 00000100:00100000:0.0:1790778765.270827:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778765.270866:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538816 00000100:00100000:0.0:1790778765.270875:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538816 00000100:00100000:0.0:1790778765.270922:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531538944 00000100:00100000:0.0:1790778765.270927:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531538944 00000100:00100000:0.0:1790778765.272568:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778765.272591:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531538816:12345-0@lo:400: 00000100:00100000:0.0:1790778765.272703:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531538816:12345-0@lo:400: Request processed in 118us (1957us total) trans 0 rc 0/0 00010000:00080000:3.0:1790778765.273126:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330ee300 x1877767531538816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778765.273144:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531538816:0@lo:400: 00000100:00080000:2.0:1790778765.274511:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778765.274532:0:5949:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790778765.274542:0:5949:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790778765.275158:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778765.275274:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531538944:12345-0@lo:400: 00000100:00100000:1.0:1790778765.275464:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531538944:12345-0@lo:400: Request processed in 294us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.275472:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778765.276234:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:0.0:1790778765.276288:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790778765.276333:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790778765.276358:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778765.276374:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778765.276387:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790778765.276391:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef2201619c0 from 1 10000000:01000000:0.0:1790778765.276395:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790778765.276432:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778765.276458:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778765.276482:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778765.276504:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531539072:0@lo:101: 00000100:00100000:0.0:1790778765.276555:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778765.276615:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cadb40 going to sleep for 11 seconds 00000004:00080000:1.0:1790778765.277286:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790778765.277397:0:7118:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790778765.277428:0:7118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539328:0@lo:7: 00000100:00100000:3.0:1790778765.277995:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531539200:0@lo:13: 00000100:00100000:1.0:1790778765.278324:0:7118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778765.278383:0:7118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220e913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778765.281557:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539328 00000100:00100000:0.0:1790778765.281574:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539328 00000100:00100000:0.0:1790778765.281655:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778765.281668:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7118:x1877767531539328:12345-0@lo:7: 00000100:00100000:3.0:1790778765.284476:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778765.284586:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539200 00000100:00100000:1.0:1790778765.284605:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539200 00000100:00100000:1.0:1790778765.284686:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790778765.284700:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531539200:12345-0@lo:13: 00002000:00000024:1.0:1790778765.285270:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923853312 avail 3692331008 00000100:00100000:1.0:1790778765.285415:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531539200:12345-0@lo:13: Request processed in 718us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.285425:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790778765.285492:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d77100 x1877767531539200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778765.285521:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531539200:0@lo:13: 00010000:00080000:2.0:1790778765.286590:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330ec000 x1877767531538944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778765.286605:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531538944:0@lo:400: 00000100:00080000:2.0:1790778765.286641:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778765.286685:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539072 00000100:00100000:2.0:1790778765.286693:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539072 00000100:00100000:2.0:1790778765.286733:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790778765.286742:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531539072:12345-0@lo:101: 00010000:00010000:2.0:1790778765.286756:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778765.286773:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607473f expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778765.286799:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607473f expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778765.287074:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607473f expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778765.287086:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165b200, rc 0) 00000100:00100000:2.0:1790778765.287170:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531539072:12345-0@lo:101: Request processed in 428us (10614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778765.287195:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790778765.287262:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531539072:0@lo:101: 00010000:00010000:2.0:1790778765.287285:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778765.287296:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778765.287395:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531539456:0@lo:501: 00000100:00100000:2.0:1790778765.287426:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778765.287478:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20884cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778765.287492:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539456 00000100:00100000:2.0:1790778765.287496:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539456 00000100:00100000:2.0:1790778765.287517:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790778765.287523:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531539456:12345-0@lo:501: 00000100:00100000:2.0:1790778765.287599:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531539456:12345-0@lo:501: Request processed in 75us (173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778765.287607:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790778765.287636:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531539456:0@lo:501: 10000000:01000000:2.0:1790778765.287660:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790778765.287666:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778765.287675:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1790778765.293052:0:6937:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1790778765.293065:0:6937:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790778765.293435:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7118:x1877767531539328:12345-0@lo:7: Request processed in 11764us (15105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.293572:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790778765.293652:0:7118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d74e00 x1877767531539328/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790778781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778765.293679:0:7118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539328:0@lo:7: 00000004:00080000:0.0:1790778765.293701:0:7118:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790778765.293758:0:7118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330efb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539584:0@lo:5: 00000100:00100000:0.0:1790778765.293827:0:7118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778765.293894:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539584 00000100:00100000:0.0:1790778765.293897:0:7118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cad600 going to sleep for 11 seconds 00000100:00100000:1.0:1790778765.293905:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539584 00000100:00100000:1.0:1790778765.293970:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778765.293981:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7118:x1877767531539584:12345-0@lo:5: 00002000:00080000:1.0:1790778765.294256:0:6934:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790778765.294261:0:6934:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1790778765.301856:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790778765.301878:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790778765.311563:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7118:x1877767531539584:12345-0@lo:5: Request processed in 17573us (17724us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790778765.311580:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790778765.311952:0:7118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330efb80 x1877767531539584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778765.313906:0:7118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790778765.313919:0:7118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330efb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539584:0@lo:5: 00000004:00080000:2.0:1790778765.313945:0:7118:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790778765.314636:0:7118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539712:0@lo:700: 00000100:00100000:2.0:1790778765.314712:0:7118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778765.314952:0:7118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20884cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778765.320162:0:6943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539712 00000100:00100000:0.0:1790778765.320176:0:6943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539712 00000100:00100000:0.0:1790778765.320236:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778765.320246:0:6943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7118:x1877767531539712:12345-0@lo:700: 00000100:00100000:0.0:1790778765.320307:0:6943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6943:1877767531539840:0@lo:700: 00000100:00100000:0.0:1790778765.320394:0:6943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778765.320434:0:6943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cad600 going to sleep for 11 seconds 00000100:00100000:2.0:1790778765.320524:0:5956:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539840 00000100:00100000:2.0:1790778765.320529:0:5956:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539840 00000100:00100000:2.0:1790778765.320565:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790778765.320572:0:5956:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6943:x1877767531539840:12345-0@lo:700: 40000000:02000000:1.0:1790778765.364391:0:5956:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00010000:00080000:0.0:1790778765.370832:0:6943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330ef100 x1877767531539840/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790778781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778765.370851:0:6943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6943:1877767531539840:0@lo:700: 40000000:02000000:0.0:1790778765.370865:0:6943:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1790778765.371278:0:5956:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6943:x1877767531539840:12345-0@lo:700: Request processed in 50698us (50875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778765.371302:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778765.401878:0:6943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7118:x1877767531539712:12345-0@lo:700: Request processed in 81623us (87155us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778765.401893:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790778765.401938:0:7118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2201ae680 x1877767531539712/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790778781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778765.401961:0:7118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539712:0@lo:700: 00000004:02000040:2.0:1790778765.412940:0:7118:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1790778765.426765:0:7118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539968:0@lo:5: 00000100:00100000:3.0:1790778765.426873:0:7118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778765.426972:0:7118:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778765.427146:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531539968 00000100:00100000:0.0:1790778765.427157:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531539968 00000100:00100000:0.0:1790778765.427552:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778765.427564:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7118:x1877767531539968:12345-0@lo:5: 00002000:00080000:1.0:1790778765.443625:0:6937:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790778765.443647:0:6937:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1790778765.449075:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7118:x1877767531539968:12345-0@lo:5: Request processed in 21505us (22194us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790778765.449094:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790778765.449383:0:7118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef205c03100 x1877767531539968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778765.449411:0:7118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7118:1877767531539968:0@lo:5: 00000004:00080000:3.0:1790778765.449432:0:7118:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1790778766.092985:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778767.115835:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778768.142183:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790778769.123726:0:7306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790778769.163757:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778770.204790:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778770.228674:0:7358:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778770.228869:0:7358:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790778770.446540:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531540096:0@lo:13: 00000100:00100000:3.0:1790778770.446617:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778770.446853:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531540480:0@lo:400: 00000100:00100000:0.0:1790778770.446887:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778770.446949:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778770.446955:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531540352:0@lo:400: 00000100:00100000:0.0:1790778770.446982:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778770.447015:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540480 00000100:00100000:0.0:1790778770.447023:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540480 00000100:00100000:0.0:1790778770.447073:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540352 00000100:00100000:0.0:1790778770.447077:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540352 00000100:00100000:0.0:1790778770.447097:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778770.447106:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531540480:12345-0@lo:400: 00000100:00100000:0.0:1790778770.447175:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531540480:12345-0@lo:400: Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778770.447183:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778770.447202:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778770.447208:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531540352:12345-0@lo:400: 00000100:00100000:0.0:1790778770.447237:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531540352:12345-0@lo:400: Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778770.447243:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790778770.447278:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330edc00 x1877767531540352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778770.447306:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531540352:0@lo:400: 00000100:00080000:2.0:1790778770.448016:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778770.448115:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531540224:0@lo:400: 00000100:00100000:1.0:1790778770.448157:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778770.448215:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540096 00000100:00100000:1.0:1790778770.448220:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540096 00000100:00100000:1.0:1790778770.448261:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778770.448269:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531540096:12345-0@lo:13: 00002000:00000024:1.0:1790778770.448305:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778770.448365:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531540096:12345-0@lo:13: Request processed in 96us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778770.448372:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790778770.448414:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef205c00000 x1877767531540096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778770.448432:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531540096:0@lo:13: 00000100:00100000:2.0:1790778770.448889:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540224 00000100:00100000:2.0:1790778770.448896:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540224 00000100:00100000:2.0:1790778770.448942:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790778770.448951:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:3440:x1877767531540224:12345-0@lo:400: 00000100:00100000:2.0:1790778770.449006:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:3440:x1877767531540224:12345-0@lo:400: Request processed in 56us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778770.449012:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1790778770.449050:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778770.449075:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531540224:0@lo:400: 00010000:00080000:0.0:1790778770.449829:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330ef480 x1877767531540480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778770.449848:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531540480:0@lo:400: 00000001:00080000:3.0:1790778770.964163:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790778771.211683:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778772.235691:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778773.262386:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778773.435439:0:7459:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778773.435888:0:7459:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790778774.283831:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778774.547861:0:7507:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778774.548353:0:7507:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1790778775.307679:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778775.563667:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531540864:0@lo:400: 00000100:00100000:0.0:1790778775.563774:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778775.563833:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531540608:0@lo:400: 00000100:00100000:0.0:1790778775.563886:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540864 00000100:00100000:3.0:1790778775.563890:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778775.563895:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540864 00000100:00100000:3.0:1790778775.563919:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778775.563925:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531540736:0@lo:400: 00000100:00100000:3.0:1790778775.563948:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778775.564015:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540608 00000100:00100000:2.0:1790778775.564020:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540608 00000100:00100000:2.0:1790778775.564055:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790778775.564064:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:3439:x1877767531540608:12345-0@lo:400: 00000100:00100000:2.0:1790778775.564125:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:3439:x1877767531540608:12345-0@lo:400: Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778775.564132:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790778775.569239:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540736 00000100:00100000:0.0:1790778775.569269:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540736 00000100:00100000:3.0:1790778775.569283:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531540608:0@lo:400: 00000100:00100000:0.0:1790778775.569357:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778775.569370:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531540864:12345-0@lo:400: 00000100:00100000:2.0:1790778775.569490:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778775.569502:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531540736:12345-0@lo:400: 00000100:00100000:2.0:1790778775.569568:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531540736:12345-0@lo:400: Request processed in 69us (5618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778775.569576:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778775.570191:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531540864:12345-0@lo:400: Request processed in 822us (6416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778775.570217:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790778775.570257:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778775.570294:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531540992:0@lo:13: 00000100:00100000:0.0:1790778775.570348:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778775.571170:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531540992 00000100:00100000:2.0:1790778775.571182:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531540992 00000100:00100000:2.0:1790778775.571263:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790778775.571273:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531540992:12345-0@lo:13: 00002000:00000024:2.0:1790778775.571313:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778775.571388:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531540992:12345-0@lo:13: Request processed in 117us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778775.571395:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790778775.571465:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2201ae680 x1877767531540992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778775.571480:0:3442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790778775.571521:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531540992:0@lo:13: 00010000:00080000:3.0:1790778775.571721:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330edc00 x1877767531540736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778775.571733:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531540736:0@lo:400: 00010000:00080000:0.0:1790778775.571865:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330ee300 x1877767531540864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778775.571878:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531540864:0@lo:400: 00000100:00080000:0.0:1790778775.571901:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778775.571957:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778775.571970:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531541120:0@lo:400: 00000100:00100000:0.0:1790778775.572019:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778775.572075:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541120 00000100:00100000:3.0:1790778775.572081:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541120 00000100:00100000:3.0:1790778775.572133:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778775.572142:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531541120:12345-0@lo:400: 00000100:00100000:3.0:1790778775.572263:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531541120:12345-0@lo:400: Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778775.572270:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790778775.572297:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330ee300 x1877767531541120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778775.572305:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531541120:0@lo:400: 00010000:00010000:0.0:1790778776.331899:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778777.363112:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778778.381566:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778779.408268:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778780.429518:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778780.683651:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531541376:0@lo:400: 00000100:00100000:0.0:1790778780.683723:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778780.683787:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778780.683793:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531541504:0@lo:400: 00000100:00100000:0.0:1790778780.683812:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778780.683846:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541376 00000100:00100000:0.0:1790778780.683853:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541376 00000100:00100000:0.0:1790778780.683895:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541504 00000100:00100000:0.0:1790778780.683898:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541504 00000100:00100000:3.0:1790778780.684029:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531541248:0@lo:400: 00000100:00100000:3.0:1790778780.684062:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778780.684096:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778780.684101:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531541632:0@lo:400: 00000100:00100000:3.0:1790778780.684123:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778780.684149:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541248 00000100:00100000:3.0:1790778780.684154:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541248 00000100:00100000:3.0:1790778780.684183:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790778780.684201:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:3440:x1877767531541248:12345-0@lo:400: 00000100:00100000:3.0:1790778780.684255:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:3440:x1877767531541248:12345-0@lo:400: Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778780.684263:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790778780.684306:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531541248:0@lo:400: 00000100:00100000:0.0:1790778780.684413:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790778780.684424:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531541376:12345-0@lo:400: 00000100:00100000:3.0:1790778780.684508:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790778780.684516:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531541504:12345-0@lo:400: 00000100:00100000:1.0:1790778780.685262:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778780.685277:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531541760:0@lo:13: 00000100:00100000:3.0:1790778780.685921:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531541504:12345-0@lo:400: Request processed in 1404us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778780.685942:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778780.686109:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531541376:12345-0@lo:400: Request processed in 1685us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778780.686130:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790778780.686152:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778780.686171:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541632 00000100:00100000:0.0:1790778780.686177:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541632 00000100:00100000:0.0:1790778780.686233:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778780.686241:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531541632:12345-0@lo:400: 00000100:00100000:0.0:1790778780.686292:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531541632:12345-0@lo:400: Request processed in 51us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778780.686299:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790778780.686356:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef205bb0000 x1877767531541632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778780.686370:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531541632:0@lo:400: 00000100:00100000:1.0:1790778780.686540:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778780.686665:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541760 00000100:00100000:1.0:1790778780.686669:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541760 00000100:00100000:1.0:1790778780.686699:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790778780.686706:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531541760:12345-0@lo:13: 00002000:00000024:1.0:1790778780.686730:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778780.686770:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531541760:12345-0@lo:13: Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778780.686776:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790778780.686806:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d76d80 x1877767531541760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778780.686820:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531541760:0@lo:13: 00000100:00080000:3.0:1790778780.687108:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778780.687247:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef205bb2300 x1877767531541504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778780.687259:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531541504:0@lo:400: 00010000:00080000:2.0:1790778780.687273:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2330edc00 x1877767531541376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778780.687282:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531541376:0@lo:400: 00010000:00010000:1.0:1790778781.458513:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778782.479972:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778783.511557:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778784.523716:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778785.547522:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778785.803923:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531541888:0@lo:13: 00000100:00100000:2.0:1790778785.804095:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778785.804304:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531541888 00000100:00100000:1.0:1790778785.804317:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531541888 00000100:00100000:1.0:1790778785.804405:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778785.804418:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531541888:12345-0@lo:13: 00002000:00000024:1.0:1790778785.804512:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1790778785.804654:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778785.804764:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531541888:12345-0@lo:13: Request processed in 349us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778785.804773:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778785.807094:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531542016:0@lo:400: 00000100:00100000:0.0:1790778785.807219:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778785.807323:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531542272:0@lo:400: 00000100:00100000:0.0:1790778785.807365:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778785.807391:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778785.807397:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531542144:0@lo:400: 00000100:00100000:0.0:1790778785.807420:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778785.807766:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542272 00000100:00100000:2.0:1790778785.807777:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542272 00000100:00100000:2.0:1790778785.807855:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542144 00000100:00100000:2.0:1790778785.807858:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542144 00000100:00100000:2.0:1790778785.807884:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778785.807896:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531542272:12345-0@lo:400: 00000100:00100000:2.0:1790778785.807992:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531542272:12345-0@lo:400: Request processed in 86us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778785.808000:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778785.808020:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790778785.808027:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531542144:12345-0@lo:400: 00000100:00100000:2.0:1790778785.808056:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531542144:12345-0@lo:400: Request processed in 31us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778785.808063:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1790778785.808121:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d75180 x1877767531542144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778785.808178:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531542144:0@lo:400: 00010000:00080000:2.0:1790778785.808194:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d76300 x1877767531542272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778785.808202:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531542272:0@lo:400: 00000100:00100000:1.0:1790778785.808358:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542016 00000100:00100000:1.0:1790778785.808364:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542016 00000100:00100000:1.0:1790778785.808406:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778785.808414:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:3442:x1877767531542016:12345-0@lo:400: 00000100:00100000:1.0:1790778785.808490:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:3442:x1877767531542016:12345-0@lo:400: Request processed in 77us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778785.808498:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778785.808562:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531542016:0@lo:400: 00000100:00080000:0.0:1790778785.808792:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790778785.810185:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef206d76d80 x1877767531541888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778785.810221:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531541888:0@lo:13: 00000020:01000004:2.0:1790778786.555126:0:8006:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790778786.555131:0:8006:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790778786.555132:0:8006:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790778786.555300:0:8006:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef235b0c800 00000020:01000004:2.0:1790778786.555320:0:8006:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790778786.555333:0:8006:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790778786.555350:0:8006:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ef23b9a4d40) 00000020:00000080:2.0:1790778786.555369:0:8006:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1790778786.575282:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790778786.621402:0:8006:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790778786.621559:0:8006:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1790778786.688633:0:8006:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790778786.689533:0:8006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790778786.689556:0:8006:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790778786.689577:0:8006:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdc87632656074754 00000020:01000004:2.0:1790778786.689588:0:8006:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790778786.689625:0:8006:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790778786.689631:0:8006:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790778786.689641:0:8006:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790778786.689692:0:8006:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790778786.689701:0:8006:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790778786.746765:0:8006:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790778786.746821:0:8006:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1790778786.746826:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790778786.746828:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790778786.746833:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778786.746834:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778786.746836:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778786.746837:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778786.746839:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778786.746840:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778786.746842:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778786.746844:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778786.746845:0:8006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790778786.746849:0:8006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1790778786.746851:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790778786.746852:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790778786.746853:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778786.746854:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790778786.746855:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778786.746856:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778786.746857:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778786.746858:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790778786.746859:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790778786.746860:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778786.746861:0:8006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790778786.746891:0:8006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790778786.746916:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531542400:0@lo:253: 00000100:00100000:0.0:1790778786.747231:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778786.747292:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778786.747432:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542400 00000100:00100000:3.0:1790778786.747470:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542400 00000100:00100000:3.0:1790778786.747521:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790778786.747540:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:8006:x1877767531542400:12345-0@lo:253: 20000000:01000000:3.0:1790778786.747593:0:5943:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790778786.747599:0:5943:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1790778786.747604:0:5943:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1790778786.747608:0:5943:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1790778786.748170:0:5943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790778786.748312:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790778786.748330:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1790778786.748347:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790778786.748353:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1790778786.748365:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790778786.748378:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790778786.748832:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790778786.748851:0:5943:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:3.0:1790778786.748854:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:3.0:1790778786.748870:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790778786.748876:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790778786.748889:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790778786.748894:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:3.0:1790778786.748907:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790778786.748914:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790778786.748927:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790778786.748943:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790778786.750884:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1790778786.750908:0:5943:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:3.0:1790778786.750911:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:3.0:1790778786.750927:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1790778786.750933:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790778786.750945:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1790778786.750950:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:3.0:1790778786.750963:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1790778786.750970:0:5943:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1790778786.750994:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1790778786.751010:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1790778786.751025:0:5943:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790778786.751027:0:5943:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790778786.751031:0:5943:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790778786.751220:0:5943:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790778786.751223:0:5943:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790778786.751881:0:8012:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790778786.751905:0:8012:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790778786.751921:0:8012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790778786.752310:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1790778786.752329:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1790778786.752341:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1790778786.752349:0:5943:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790778786.752351:0:5943:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790778786.753037:0:8013:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1790778786.753240:0:8013:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1790778786.753260:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790778786.753679:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790778786.753702:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790778786.753716:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1790778786.753727:0:5943:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790778786.753729:0:5943:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790778786.754242:0:8014:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1790778786.754266:0:8014:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1790778786.754276:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1790778786.754422:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1790778786.754619:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1790778786.754642:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1790778786.754650:0:5943:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790778786.754652:0:5943:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790778786.755003:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790778786.755284:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790778786.755305:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790778786.755319:0:5943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1790778786.755333:0:5943:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790778786.755352:0:5943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755369:0:5943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746a5 expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755377:0:5943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746cf expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755397:0:5943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746f9 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755404:0:5943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074715 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755410:0:5943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607473f expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755418:0:5943:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755837:0:5943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607473f expref: 16 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.755854:0:5943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607473f expref: 16 pid: 5943 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.755869:0:5943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542528:0@lo:104: 00000100:00100000:3.0:1790778786.755937:0:5943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790778786.756038:0:5943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074715 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.756058:0:5943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074715 expref: 16 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.756074:0:5943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542656:0@lo:104: 00010000:00010000:3.0:1790778786.756101:0:5943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560746f9 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.756122:0:5943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560746f9 expref: 16 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.756130:0:5943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542784:0@lo:104: 00010000:00010000:3.0:1790778786.756168:0:5943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560746cf expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.756176:0:5943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560746cf expref: 16 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.756183:0:5943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c01c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542912:0@lo:104: 00010000:00010000:3.0:1790778786.756204:0:5943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560746a5 expref: 16 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.756210:0:5943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560746a5 expref: 16 pid: 5942 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.756218:0:5943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c01500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531543040:0@lo:104: 00000100:00100000:3.0:1790778786.756234:0:5943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef210134600 going to sleep for 11 seconds 00000100:00100000:1.0:1790778786.758960:0:5932:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790778786.759015:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.759068:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.759078:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.759088:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.759100:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542528 00000100:00100000:1.0:1790778786.759109:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542528 00000100:00100000:1.0:1790778786.759155:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542656 00000100:00100000:1.0:1790778786.759158:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542656 00000100:00100000:1.0:1790778786.759167:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542784 00000100:00100000:1.0:1790778786.759170:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542784 00000100:00100000:1.0:1790778786.759177:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531542912 00000100:00100000:1.0:1790778786.759179:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531542912 00000100:00100000:1.0:1790778786.759186:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543040 00000100:00100000:1.0:1790778786.759188:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543040 00000100:00100000:1.0:1790778786.759201:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778786.759211:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef207dd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+7:5943:x1877767531542528:12345-0@lo:104: 00010000:00010000:1.0:1790778786.759232:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759333:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790778786.759354:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef207dd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+7:5943:x1877767531542528:12345-0@lo:104: Request processed in 144us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.759361:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778786.759408:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778786.759414:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+6:5943:x1877767531542656:12345-0@lo:104: 00010000:00010000:1.0:1790778786.759422:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759482:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790778786.759487:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+6:5943:x1877767531542656:12345-0@lo:104: Request processed in 73us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.759494:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778786.759504:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778786.759509:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+5:5943:x1877767531542784:12345-0@lo:104: 00010000:00010000:1.0:1790778786.759516:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759555:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790778786.759560:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+5:5943:x1877767531542784:12345-0@lo:104: Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.759565:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778786.759579:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778786.759584:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:5943:x1877767531542912:12345-0@lo:104: 00010000:00010000:1.0:1790778786.759592:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759614:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790778786.759623:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:5943:x1877767531542912:12345-0@lo:104: Request processed in 39us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.759629:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778786.759639:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778786.759644:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:5943:x1877767531543040:12345-0@lo:104: 00010000:00010000:1.0:1790778786.759651:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759673:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790778786.759678:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:5943:x1877767531543040:12345-0@lo:104: Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.759684:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790778786.759706:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790778786.759713:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759720:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778786.759725:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759734:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778786.759742:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.759759:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778786.759800:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759816:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778786.759838:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759846:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1400/0xdc8763265607473f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074746 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759861:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790778786.759864:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759869:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201498800 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778786.759873:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759880:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778786.759886:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.759891:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778786.759902:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759907:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778786.759911:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759917:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef201498800/0xdc87632656074715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607471c expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759944:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790778786.759948:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759953:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201499600 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778786.759957:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759963:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778786.759968:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.759973:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778786.759984:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.759989:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778786.760001:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760007:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef201499600/0xdc876326560746f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074700 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760023:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790778786.760025:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760039:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778786.760043:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760049:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778786.760055:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.760060:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778786.760069:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760074:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778786.760079:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760085:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc876326560746cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746d6 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760093:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778786.760095:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760101:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778786.760104:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760120:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778786.760127:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.760132:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778786.760156:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760161:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778786.760165:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760170:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc876326560746a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746ac expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760186:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778786.760188:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778786.760190:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778786.760196:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778786.760201:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778786.760226:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531543168:0@lo:103: 00000100:00100000:1.0:1790778786.760268:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.760311:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531543680:0@lo:103: 00000100:00100000:1.0:1790778786.760330:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.760352:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790778786.760357:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531543296:0@lo:103: 00000100:00100000:1.0:1790778786.760384:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.760426:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531543424:0@lo:103: 00000100:00100000:1.0:1790778786.760475:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.760497:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778786.760502:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531543552:0@lo:103: 00000100:00100000:1.0:1790778786.760520:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.760545:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543168 00000100:00100000:1.0:1790778786.760550:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543168 00010000:00010000:1.0:1790778786.760574:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607473f expref: 17 pid: 5943 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.760593:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543680 00000100:00100000:1.0:1790778786.760595:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543680 00010000:00010000:1.0:1790778786.760606:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746a5 expref: 18 pid: 5942 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.760616:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543296 00000100:00100000:1.0:1790778786.760619:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543296 00010000:00010000:1.0:1790778786.760629:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074715 expref: 19 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.760637:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543424 00000100:00100000:1.0:1790778786.760639:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543424 00010000:00010000:1.0:1790778786.760647:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746f9 expref: 20 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.760655:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543552 00000100:00100000:1.0:1790778786.760657:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543552 00010000:00010000:1.0:1790778786.760665:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746cf expref: 21 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.760688:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778786.760695:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+21:3441:x1877767531543168:12345-0@lo:103: 00010000:00010000:1.0:1790778786.760708:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.760714:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607473f expref: 21 pid: 5943 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760726:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607473f expref: 21 pid: 5943 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760747:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.760784:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+21:3441:x1877767531543168:12345-0@lo:103: Request processed in 89us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.760791:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778786.760806:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778786.760811:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+20:3441:x1877767531543680:12345-0@lo:103: 00010000:00010000:1.0:1790778786.760819:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.760823:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746a5 expref: 20 pid: 5942 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760831:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560746a5 expref: 20 pid: 5942 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760840:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.760863:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+20:3441:x1877767531543680:12345-0@lo:103: Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.760868:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778786.760879:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778786.760892:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531543296:12345-0@lo:103: 00010000:00010000:1.0:1790778786.760900:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.760904:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074715 expref: 19 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760912:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074715 expref: 19 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760920:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.760939:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531543296:12345-0@lo:103: Request processed in 48us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.760945:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778786.760957:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778786.760962:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+18:3439:x1877767531543424:12345-0@lo:103: 00010000:00010000:1.0:1790778786.760970:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.760974:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746f9 expref: 18 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760981:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560746f9 expref: 18 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.760990:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.761014:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+18:3439:x1877767531543424:12345-0@lo:103: Request processed in 52us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.761020:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778786.761034:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778786.761039:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+17:3439:x1877767531543552:12345-0@lo:103: 00010000:00010000:1.0:1790778786.761046:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.761056:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746cf expref: 17 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.761064:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560746cf expref: 17 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.761074:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.761083:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.761789:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165b200/0xdc87632656074746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607473f expref: 17 pid: 5943 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.761823:0:5943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542528:0@lo:104: 00010000:00010000:2.0:1790778786.761853:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499e00/0xdc8763265607471c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074715 expref: 16 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.761874:0:5943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542656:0@lo:104: 00010000:00010000:2.0:1790778786.761885:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014ab200/0xdc87632656074700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560746f9 expref: 15 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.761895:0:5943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542784:0@lo:104: 00010000:00010000:2.0:1790778786.761905:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014abc00/0xdc876326560746d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560746cf expref: 14 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.761912:0:5943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c01c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531542912:0@lo:104: 00010000:00010000:2.0:1790778786.761920:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201498c00/0xdc876326560746ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560746a5 expref: 13 pid: 5942 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.761939:0:5943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c01500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5943:1877767531543040:0@lo:104: 00000100:00100000:0.0:1790778786.764709:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531543296:0@lo:103: 00000100:00100000:0.0:1790778786.764724:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531543168:0@lo:103: 00000100:00100000:0.0:1790778786.764732:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531543680:0@lo:103: 00010000:00010000:2.0:1790778786.764944:0:5943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.765212:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.765224:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.765232:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.765241:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.765248:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201499c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790778786.765253:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.765262:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.765387:0:5943:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.765396:0:5943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790778786.765405:0:5943:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790778786.767660:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531543424:0@lo:103: 00010000:00010000:1.0:1790778786.767921:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.767970:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499c00/0xdc8763265607475b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.768002:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.768255:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+12:3439:x1877767531543552:12345-0@lo:103: Request processed in 7213us (7731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.768265:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790778786.768349:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531543552:0@lo:103: 00000100:00100000:2.0:1790778786.779091:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+11:8006:x1877767531542400:12345-0@lo:253: Request processed in 31550us (31848us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.779110:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790778786.779294:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531542400:0@lo:253: 10000000:01000000:0.0:1790778786.779311:0:8006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790778786.779315:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790778786.779316:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790778786.779318:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790778786.779319:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790778786.779320:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790778786.779321:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790778786.779323:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790778786.779325:0:8006:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790778786.779327:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790778786.779328:0:8006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790778786.779351:0:8006:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef235b0c800 from lustre-OST0001 10000000:01000000:0.0:1790778786.779386:0:8006:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790778786.779389:0:8006:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790778786.779398:0:8006:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef2201619c0 local copy 10000000:01000000:0.0:1790778786.779402:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790778786.779471:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.779484:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.779494:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778786.779513:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531543808:0@lo:101: 00000100:00100000:0.0:1790778786.779679:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778786.779725:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205badf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778786.779872:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543808 00000100:00100000:3.0:1790778786.779880:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543808 00000100:00100000:3.0:1790778786.779925:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790778786.779934:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531543808:12345-0@lo:101: 00010000:00010000:3.0:1790778786.779952:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778786.779970:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201499c00/0xdc87632656074769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074762 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.779994:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499c00/0xdc87632656074769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074762 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.780019:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201499c00/0xdc87632656074769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074762 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.780030:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201499c00, rc 0) 00000100:00100000:3.0:1790778786.780418:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531543808:12345-0@lo:101: Request processed in 484us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778786.780426:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790778786.780566:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531543808:0@lo:101: 00010000:00010000:0.0:1790778786.780582:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.780601:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778786.780724:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531543936:0@lo:501: 00000100:00100000:0.0:1790778786.781316:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778786.781362:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205badf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790778786.781483:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531543936 00000100:00100000:3.0:1790778786.781490:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531543936 00000100:00100000:0.0:1790778786.781615:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790778786.781626:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531543936:12345-0@lo:501: 00000100:00100000:0.0:1790778786.781699:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531543936:12345-0@lo:501: Request processed in 75us (384us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778786.781707:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790778786.781891:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531543936:0@lo:501: 10000000:01000000:2.0:1790778786.781907:0:8006:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790778786.781931:0:8006:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790778786.781937:0:8006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.781947:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.781955:0:8006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.781975:0:8006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790778786.782000:0:8006:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef235b0c800 10000000:01000000:2.0:1790778786.782005:0:8006:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790778786.782010:0:8006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790778786.782013:0:8006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790778786.782017:0:8006:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790778786.782019:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790778786.782041:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.782218:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.782243:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.782260:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544064:0@lo:101: 00000100:00100000:2.0:1790778786.782293:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.782324:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.782338:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544064 00000100:00100000:2.0:1790778786.782343:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544064 00000100:00100000:2.0:1790778786.782364:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790778786.782369:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544064:12345-0@lo:101: 00010000:00010000:2.0:1790778786.782379:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778786.782391:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074770 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.782413:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074770 expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.782424:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074770 expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.782434:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165ae00, rc 0) 00000100:00100000:2.0:1790778786.782486:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544064:12345-0@lo:101: Request processed in 116us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.782492:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790778786.782515:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544064:0@lo:101: 00010000:00010000:2.0:1790778786.782597:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.782617:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.782694:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544192:0@lo:501: 00000100:00100000:2.0:1790778786.782719:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.782726:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790778786.782920:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778786.782928:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.782936:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778786.782940:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.782948:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778786.782956:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778786.782962:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790778786.782981:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.782994:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778786.783024:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.783032:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc87632656074762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdc87632656074769 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.783045:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778786.783255:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544192 00000100:00100000:2.0:1790778786.783261:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544192 00000100:00100000:2.0:1790778786.783283:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790778786.783289:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544192:12345-0@lo:501: 00000100:00100000:2.0:1790778786.783387:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544192:12345-0@lo:501: Request processed in 97us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.783394:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790778786.783417:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544192:0@lo:501: 00000100:00100000:2.0:1790778786.783461:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544448:0@lo:503: 00000100:00100000:2.0:1790778786.783498:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.783517:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790778786.783614:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778786.783617:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778786.783626:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778786.783636:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531544320:0@lo:103: 00000100:00100000:3.0:1790778786.783703:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544448 00000100:00100000:3.0:1790778786.783707:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544448 00000100:00100000:3.0:1790778786.783724:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790778786.783730:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544448:12345-0@lo:503: 00000100:00100000:0.0:1790778786.784026:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.784291:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544320 00000100:00100000:1.0:1790778786.784297:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544320 00000100:00100000:1.0:1790778786.784343:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778786.784351:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+14:3441:x1877767531544320:12345-0@lo:103: 00010000:00010000:1.0:1790778786.784361:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.784376:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499c00/0xdc87632656074769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc87632656074762 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.784399:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.784466:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+13:3441:x1877767531544320:12345-0@lo:103: Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.784474:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790778786.784504:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531544320:0@lo:103: 00000100:00100000:3.0:1790778786.785264:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544448:12345-0@lo:503: Request processed in 1532us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778786.785274:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790778786.785340:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544448:0@lo:503: 00000040:00080000:2.0:1790778786.785949:0:8006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778786.786070:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544576:0@lo:502: 00000100:00100000:2.0:1790778786.786409:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.786488:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778786.786578:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544576 00000100:00100000:3.0:1790778786.786585:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544576 00000100:00100000:3.0:1790778786.786620:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790778786.786629:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544576:12345-0@lo:502: 00000100:00100000:3.0:1790778786.786754:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544576:12345-0@lo:502: Request processed in 126us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778786.786760:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790778786.787315:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544576:0@lo:502: 00000040:00080000:0.0:1790778786.787577:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790778786.787609:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790778786.787624:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790778786.787638:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790778786.787652:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790778786.787665:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790778786.787694:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544704:0@lo:502: 00000100:00100000:0.0:1790778786.787934:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778786.787976:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bada80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778786.788066:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544704 00000100:00100000:3.0:1790778786.788073:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544704 00000100:00100000:0.0:1790778786.788619:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790778786.788634:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544704:12345-0@lo:502: 00000100:00100000:0.0:1790778786.789324:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544704:12345-0@lo:502: Request processed in 693us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.789343:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790778786.789938:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544704:0@lo:502: 00000040:00080000:2.0:1790778786.790229:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790778786.790256:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790778786.792426:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790778786.792438:0:8016:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790778786.792716:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778786.792719:0:8016:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790778786.792727:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790778786.792874:0:8016:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ef2331e0000) 00000020:00000080:0.0:1790778786.792902:0:8016:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790778786.792912:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790778786.792985:0:8016:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef235b0c800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790778786.792995:0:8016:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790778786.793002:0:8016:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdc87632656074785 00010000:00010000:3.0:1790778786.801680:0:8016:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1790778786.803413:0:8016:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790778786.807411:0:8016:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790778786.807836:0:8016:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790778786.816846:0:8016:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1790778786.817056:0:8016:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1790778786.828703:0:8016:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1790778786.831952:0:8016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790778786.831971:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778786.831980:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778786.831983:0:8016:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790778786.831987:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778786.831991:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778786.831992:0:8016:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790778786.831995:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790778786.831997:0:8016:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790778786.832029:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778786.832032:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778786.832033:0:8016:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790778786.832037:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790778786.840758:0:8006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790778786.840808:0:8006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790778786.840837:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.840851:0:8006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778786.840860:0:8006:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef235b0c800 from 1 10000000:01000000:0.0:1790778786.840863:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790778786.840905:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.840914:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.840925:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778786.840969:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544832:0@lo:101: 00000100:00100000:0.0:1790778786.841056:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778786.841111:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bad180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.842396:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544832 00000100:00100000:2.0:1790778786.842409:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544832 00000100:00100000:2.0:1790778786.842499:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790778786.842510:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:8006:x1877767531544832:12345-0@lo:101: 00010000:00010000:2.0:1790778786.842539:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778786.842558:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607478c expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.842585:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607478c expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.842594:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607478c expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.842603:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165a600, rc 0) 00000100:00100000:2.0:1790778786.842669:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544832:12345-0@lo:101: Request processed in 161us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.842691:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790778786.842887:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544832:0@lo:101: 00010000:00010000:2.0:1790778786.842905:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.842915:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778786.843039:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544960:0@lo:501: 00000100:00100000:2.0:1790778786.843482:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.843517:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.844732:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531544960 00000100:00100000:2.0:1790778786.844812:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531544960 00000100:00100000:2.0:1790778786.844878:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790778786.844887:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544960:12345-0@lo:501: 00000100:00100000:2.0:1790778786.845711:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531544960:12345-0@lo:501: Request processed in 161us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.845722:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790778786.845813:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531544960:0@lo:501: 00000100:00100000:2.0:1790778786.845865:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545088:0@lo:503: 00000100:00100000:2.0:1790778786.845922:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.845955:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790778786.848212:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545088 00000100:00100000:0.0:1790778786.848233:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545088 00000100:00100000:0.0:1790778786.848315:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790778786.848326:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545088:12345-0@lo:503: 00000100:00100000:0.0:1790778786.848576:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545088:12345-0@lo:503: Request processed in 252us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.848584:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790778786.849026:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545088:0@lo:503: 00000040:00080000:2.0:1790778786.849619:0:8006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790778786.849739:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545216:0@lo:502: 00000100:00100000:2.0:1790778786.849827:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.849876:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2100f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778786.850342:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545216 00000100:00100000:3.0:1790778786.850350:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545216 00000100:00100000:3.0:1790778786.850402:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790778786.850413:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545216:12345-0@lo:502: 00000100:00100000:3.0:1790778786.850571:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545216:12345-0@lo:502: Request processed in 161us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778786.850579:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790778786.851696:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545216:0@lo:502: 00000040:00080000:3.0:1790778786.851986:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790778786.852018:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790778786.853496:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545344:0@lo:502: 00000100:00100000:3.0:1790778786.853984:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778786.854032:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d900 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.854819:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545344 00000100:00100000:2.0:1790778786.854828:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545344 00000100:00100000:2.0:1790778786.855187:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790778786.855199:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545344:12345-0@lo:502: 00000100:00100000:2.0:1790778786.855383:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545344:12345-0@lo:502: Request processed in 186us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.855393:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790778786.855516:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545344:0@lo:502: 00000040:00080000:3.0:1790778786.855613:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790778786.855627:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790778786.856948:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778786.856960:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778786.856962:0:8020:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790778786.856970:0:8020:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef235b0c800 00000020:00000080:3.0:1790778786.856972:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790778786.856985:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778786.856987:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778786.856989:0:8020:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790778786.856991:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790778786.857316:0:8006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790778786.857343:0:8006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778786.857367:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.857379:0:8006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.857469:0:8006:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790778786.857472:0:8006:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef235b0c800 10000000:01000000:1.0:1790778786.857475:0:8006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef235b0c800 10000000:01000000:1.0:1790778786.857479:0:8006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790778786.857484:0:8006:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef235b0c800 from 1 10000000:01000000:1.0:1790778786.857487:0:8006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790778786.857519:0:8006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.857537:0:8006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.857548:0:8006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.857572:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545472:0@lo:101: 00000100:00100000:1.0:1790778786.857637:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.857938:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778786.858013:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545472 00000100:00100000:0.0:1790778786.858022:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545472 00000100:00100000:0.0:1790778786.858078:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790778786.858087:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8006:x1877767531545472:12345-0@lo:101: 00010000:00010000:0.0:1790778786.858104:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778786.858129:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607479a expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.858166:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607479a expref: 14 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.858177:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607479a expref: 14 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778786.858187:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1200, rc 0) 00000100:00100000:0.0:1790778786.858240:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545472:12345-0@lo:101: Request processed in 154us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.858265:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790778786.858695:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545472:0@lo:101: 00010000:00010000:1.0:1790778786.858711:0:8006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.858721:0:8006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.858824:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545600:0@lo:501: 00000100:00100000:1.0:1790778786.858857:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.858880:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778786.859033:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545600 00000100:00100000:0.0:1790778786.859039:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545600 00000100:00100000:0.0:1790778786.859083:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790778786.859091:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545600:12345-0@lo:501: 00000100:00100000:0.0:1790778786.859228:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545600:12345-0@lo:501: Request processed in 138us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.859235:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790778786.859312:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545600:0@lo:501: 00000100:00100000:1.0:1790778786.859355:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545728:0@lo:503: 00000100:00100000:1.0:1790778786.859392:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.859428:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778786.859788:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545728 00000100:00100000:0.0:1790778786.859794:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545728 00000100:00100000:0.0:1790778786.859820:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790778786.859828:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545728:12345-0@lo:503: 00000100:00100000:0.0:1790778786.859935:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545728:12345-0@lo:503: Request processed in 108us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.859942:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790778786.860039:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545728:0@lo:503: 00000040:00080000:1.0:1790778786.860367:0:8006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790778786.860462:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545856:0@lo:502: 00000100:00100000:1.0:1790778786.860504:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778786.860636:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545856 00000100:00100000:0.0:1790778786.860643:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545856 00000100:00100000:0.0:1790778786.860668:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790778786.860675:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545856:12345-0@lo:502: 00000100:00100000:0.0:1790778786.860770:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545856:12345-0@lo:502: Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.860777:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790778786.861010:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778786.861024:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545856:0@lo:502: 00000040:00080000:1.0:1790778786.861282:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790778786.861311:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790778786.861328:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790778786.861342:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790778786.861355:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790778786.861367:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790778786.861379:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790778786.861404:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790778786.861420:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790778786.861434:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790778786.861776:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790778786.861793:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790778786.861808:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790778786.861822:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790778786.861836:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790778786.861849:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790778786.861861:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790778786.861872:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790778786.861895:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790778786.861908:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790778786.861921:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790778786.861934:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790778786.861948:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790778786.861976:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790778786.861993:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790778786.862007:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790778786.862021:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790778786.862033:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790778786.862242:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790778786.862264:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790778786.862281:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790778786.862296:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790778786.862311:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790778786.862325:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790778786.862340:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790778786.862352:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790778786.862362:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790778786.862394:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545984:0@lo:502: 00000100:00100000:1.0:1790778786.862622:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.862757:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.864424:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531545984 00000100:00100000:2.0:1790778786.864438:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531545984 00000100:00100000:2.0:1790778786.864520:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790778786.864891:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545984:12345-0@lo:502: 00000100:00100000:2.0:1790778786.865280:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531545984:12345-0@lo:502: Request processed in 750us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.865288:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790778786.865397:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531545984:0@lo:502: 00000040:00080000:1.0:1790778786.865507:0:8006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1790778786.865522:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790778786.866018:0:8021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790778786.866057:0:8021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ef2362599c0) 00000020:00000080:1.0:1790778786.866615:0:8021:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1790778786.866708:0:8021:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef235b0c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790778786.866712:0:8021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef235b0c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790778786.866715:0:8021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef235b0c800 3 00010000:00080000:1.0:1790778786.866753:0:8021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef236261800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1790778786.870996:0:8021:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790778786.871292:0:8021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790778786.871343:0:8021:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790778786.871358:0:8021:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdc876326560747af 00000100:00080000:0.0:1790778786.871369:0:8021:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790778786.871391:0:8021:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ef236261800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1790778786.871434:0:8021:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef205bb3b80 x1877767531546112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790778786.871498:0:8021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790778786.871818:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531546112:0@lo:38: 00000100:00100000:2.0:1790778786.871907:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.872058:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546112 00000100:00100000:2.0:1790778786.872066:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546112 00000100:00100000:2.0:1790778786.872098:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778786.872105:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531546112:12345-0@lo:38: 00010000:00080000:2.0:1790778786.872130:0:5949:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1790778786.872187:0:5949:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdc876326560747b6 00000004:00100000:2.0:1790778786.872205:0:5949:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790778786.872241:0:5949:0:(import.c:65:import_set_state_nolock()) ffff9ef235fc2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778786.872297:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3438:x1877767531546112:12345-0@lo:38: Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.872315:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778786.872338:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531546240:0@lo:400: 00000100:00100000:2.0:1790778786.872364:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.872385:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778786.872391:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531546368:0@lo:400: 00000100:00100000:2.0:1790778786.872428:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.872477:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546240 00000100:00100000:2.0:1790778786.872481:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546240 00000100:00100000:2.0:1790778786.872511:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546368 00000100:00100000:2.0:1790778786.872514:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546368 00000100:00100000:2.0:1790778786.872730:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790778786.872741:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531546240:12345-0@lo:400: 00000100:00100000:2.0:1790778786.872783:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531546240:12345-0@lo:400: Request processed in 45us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.872789:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790778786.872802:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778786.872809:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531546368:12345-0@lo:400: 00000100:00100000:2.0:1790778786.872837:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531546368:12345-0@lo:400: Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.872843:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790778786.873022:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2201ac700 x1877767531546368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778786.873035:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531546368:0@lo:400: 00010000:00080000:2.0:1790778786.873046:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2201ac380 x1877767531546240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778786.873054:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531546240:0@lo:400: 00010000:00080000:2.0:1790778786.873093:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef205bb3b80 x1877767531546112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790778796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778786.873102:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790778786.873107:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790778786.873115:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790778786.873120:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790778786.873123:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790778786.873129:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531546112:0@lo:38: 00000040:00080000:0.0:1790778786.873811:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1790778786.874053:0:8006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1790778786.874096:0:8006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778786.874123:0:8006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778786.874145:0:8006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790778786.874388:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790778786.874390:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790778786.874392:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778786.874393:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778786.874394:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778786.874395:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778786.874397:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778786.874398:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778786.874400:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778786.874402:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778786.874403:0:8006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790778786.874407:0:8006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790778786.874410:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790778786.874411:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790778786.874412:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790778786.874418:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790778786.874419:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790778786.874420:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790778786.874421:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790778786.874422:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790778786.874422:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790778786.874423:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790778786.874424:0:8006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790778786.874471:0:8006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790778786.874490:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531546624:0@lo:253: 00000100:00100000:2.0:1790778786.874621:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.874664:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20419eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.874685:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546624 00000100:00100000:2.0:1790778786.874691:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546624 00000100:00100000:2.0:1790778786.874731:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790778786.874740:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531546624:12345-0@lo:253: 20000000:01000000:2.0:1790778786.874768:0:5944:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790778786.874781:0:5944:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790778786.875680:0:8022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8022:1877767531546752:0@lo:901: 00000100:00100000:2.0:1790778786.875760:0:8022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778786.877797:0:8022:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20419ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778786.882092:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531546496:0@lo:400: 00000100:00100000:1.0:1790778786.882219:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778786.882495:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546496 00000100:00100000:3.0:1790778786.882510:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546496 00000100:00100000:3.0:1790778786.882596:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778786.882608:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531546496:12345-0@lo:400: 00000100:00100000:3.0:1790778786.882683:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531546496:12345-0@lo:400: Request processed in 76us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778786.882692:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790778786.883418:0:5960:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546752 00000100:00100000:0.0:1790778786.883431:0:5960:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546752 00000100:00080000:3.0:1790778786.883565:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790778786.883792:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2201aca80 x1877767531546496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778786.883812:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531546496:0@lo:400: 00000100:00100000:0.0:1790778786.887700:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778786.887727:0:5960:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8022:x1877767531546752:12345-0@lo:901: 00000100:00100000:0.0:1790778786.887901:0:5960:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8022:x1877767531546752:12345-0@lo:901: Request processed in 185us (12141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778786.887910:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790778786.888038:0:8022:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2201ac700 x1877767531546752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790778802 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778786.888809:0:8022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8022:1877767531546752:0@lo:901: 20000000:01000000:2.0:1790778786.892882:0:5944:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790778786.892909:0:5944:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790778786.893367:0:5965:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790778786.893374:0:5965:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790778786.893400:0:5965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.893423:0:5965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.893434:0:5965:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.893539:0:5965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778786.893562:0:5965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.893581:0:5965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c01500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1877767531546880:0@lo:104: 00000100:00100000:3.0:1790778786.893683:0:5965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778786.893747:0:5965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d900 going to sleep for 11 seconds 00000100:00100000:2.0:1790778786.894423:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8006:x1877767531546624:12345-0@lo:253: Request processed in 19678us (19796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778786.894462:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790778786.894665:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531546880 00000100:00100000:1.0:1790778786.894679:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531546880 00000100:00100000:1.0:1790778786.894743:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790778786.894754:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:5965:x1877767531546880:12345-0@lo:104: 00010000:00010000:1.0:1790778786.894772:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.894836:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790778786.894842:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:5965:x1877767531546880:12345-0@lo:104: Request processed in 91us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.894849:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790778786.894890:0:5965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c01500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5965:1877767531546880:0@lo:104: 00010000:00010000:1.0:1790778786.894914:0:5965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.894934:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778786.894940:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.894948:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778786.894951:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.894980:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778786.894987:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778786.894993:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778786.895038:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.895272:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778786.895299:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.895308:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa600/0xdc87632656074707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607470e expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.895332:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778786.895334:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778786.895336:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778786.895360:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531547008:0@lo:103: 00000100:00100000:1.0:1790778786.895405:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778786.895479:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547008 00000100:00100000:1.0:1790778786.895484:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547008 00010000:00010000:1.0:1790778786.895508:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778786.896776:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:763f742b-0483-425a-8826-84839ee976ad:8006:1877767531546624:0@lo:253: 10000000:01000000:3.0:1790778786.896799:0:8006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790778786.896823:0:8006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790778786.896824:0:8006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790778786.896826:0:8006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790778786.896827:0:8006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790778786.896829:0:8006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790778786.896830:0:8006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790778786.896832:0:8006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790778786.896834:0:8006:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790778786.896835:0:8006:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790778786.896837:0:8006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790778786.896838:0:8006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790778786.896856:0:8006:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790778786.897308:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790778786.897326:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+14:3442:x1877767531547008:12345-0@lo:103: 00010000:00010000:1.0:1790778786.897354:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778786.897365:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897381:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897403:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201498200/0xdc8763265607470e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074707 expref: 14 pid: 5944 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897436:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897464:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790778786.897486:0:5934:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004111801s 00010000:00010000:1.0:1790778786.897491:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897498:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897505:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897513:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897519:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201499600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790778786.897524:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897552:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897577:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897589:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778786.897681:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+13:3442:x1877767531547008:12345-0@lo:103: Request processed in 362us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778786.897690:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790778786.897765:0:5965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897775:0:5965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778786.897781:0:5965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499600/0xdc876326560747bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778786.897832:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531547008:0@lo:103: 00080000:10000000:3.0:1790778786.913906:0:8006:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1790778786.914104:0:8006:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1790778786.914725:0:8006:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1790778786.914880:0:8006:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1790778786.915084:0:8006:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790778786.916328:0:8006:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1790778786.919230:0:8006:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790778786.929969:0:8006:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790778786.929981:0:8006:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790778786.930026:0:8006:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790778786.930083:0:8006:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790778786.930108:0:8006:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790778786.930152:0:8006:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1790778786.931072:0:8006:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778786.931280:0:8006:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1790778787.603528:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778788.100118:0:8075:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778788.100394:0:8075:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790778788.623674:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778789.644733:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778790.668392:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778790.935597:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531547136:0@lo:13: 00000100:00100000:1.0:1790778790.935697:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778790.935820:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547136 00000100:00100000:1.0:1790778790.935829:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547136 00000100:00100000:1.0:1790778790.935899:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790778790.935926:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531547136:12345-0@lo:13: 00002000:00000024:1.0:1790778790.935970:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778790.936023:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531547136:12345-0@lo:13: Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778790.936045:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790778790.936069:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790778790.936116:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d76300 x1877767531547136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778790.936137:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531547136:0@lo:13: 00010000:00010000:0.0:1790778791.691779:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778791.954128:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531547264:0@lo:400: 00000100:00100000:0.0:1790778791.954598:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531547392:0@lo:400: 00000100:00100000:0.0:1790778791.954645:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778791.955795:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778791.955832:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531547520:0@lo:400: 00000100:00100000:2.0:1790778791.955870:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531547776:0@lo:400: 00000100:00100000:3.0:1790778791.955905:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778791.955932:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531547648:0@lo:400: 00000100:00100000:3.0:1790778791.955956:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547392 00000100:00100000:3.0:1790778791.955967:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547392 00000100:00100000:0.0:1790778791.955967:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778791.956018:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547520 00000100:00100000:3.0:1790778791.956022:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547520 00000100:00100000:2.0:1790778791.956052:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547648 00000100:00100000:2.0:1790778791.956058:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547648 00000100:00100000:2.0:1790778791.956109:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778791.956123:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531547648:12345-0@lo:400: 00000100:00100000:2.0:1790778791.956213:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531547648:12345-0@lo:400: Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778791.956222:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790778791.956596:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790778791.956606:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531547392:12345-0@lo:400: 00010000:00080000:2.0:1790778791.956730:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201af800 x1877767531547392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778791.956746:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531547392:0@lo:400: 00000100:00100000:0.0:1790778791.956780:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531547392:12345-0@lo:400: Request processed in 57us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778791.956789:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790778791.956807:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790778791.956814:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531547520:12345-0@lo:400: 00000100:00100000:0.0:1790778791.956864:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531547520:12345-0@lo:400: Request processed in 51us (961us total) trans 0 rc 0/0 00010000:00080000:2.0:1790778791.956911:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201aed80 x1877767531547520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778791.956924:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531547520:0@lo:400: 00000100:00100000:0.0:1790778791.957251:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790778791.957278:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547264 00000100:00100000:0.0:1790778791.957284:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547264 00000100:00100000:0.0:1790778791.957324:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790778791.957332:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:3440:x1877767531547264:12345-0@lo:400: 00000100:00100000:0.0:1790778791.957370:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:3440:x1877767531547264:12345-0@lo:400: Request processed in 38us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778791.957376:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1790778791.957416:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201adf80 x1877767531547648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778791.957429:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531547648:0@lo:400: 00000100:00100000:2.0:1790778791.958536:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778791.958602:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547776 00000100:00100000:0.0:1790778791.958611:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547776 00000100:00100000:2.0:1790778791.958622:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531547264:0@lo:400: 00000100:00100000:0.0:1790778791.958672:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790778791.958681:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531547776:12345-0@lo:400: 00000100:00100000:0.0:1790778791.959344:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531547776:12345-0@lo:400: Request processed in 661us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778791.959354:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790778791.959527:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201ad500 x1877767531547776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778791.959541:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531547776:0@lo:400: 00000100:00080000:0.0:1790778791.959828:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778792.720644:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778793.743780:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790778793.818821:0:8365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790778794.763812:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790778794.789104:0:8417:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778794.792862:0:8417:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790778795.791476:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790778796.043621:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790778796.043629:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef2332da000 from 30 10000000:01000000:0.0:1790778796.043634:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790778796.043665:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778796.043698:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778796.043711:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778796.043735:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548032:0@lo:101: 00000100:00100000:2.0:1790778796.043805:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531547904:0@lo:13: 00000100:00100000:0.0:1790778796.043830:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.043838:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778796.043905:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.044474:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548032 00000100:00100000:1.0:1790778796.044485:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548032 00000100:00100000:1.0:1790778796.044546:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790778796.044557:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531548032:12345-0@lo:101: 00010000:00010000:1.0:1790778796.044574:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778796.044591:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560747c4 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.044615:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560747c4 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.044626:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747c4 expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.044635:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aba00, rc 0) 00000100:00100000:0.0:1790778796.044849:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531547904 00000100:00100000:0.0:1790778796.044854:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531547904 00000100:00100000:0.0:1790778796.044904:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790778796.044911:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531547904:12345-0@lo:13: 00002000:00000024:0.0:1790778796.044934:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1790778796.045059:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778796.049345:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531548032:12345-0@lo:101: Request processed in 4780us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.049377:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790778796.049998:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548032:0@lo:101: 00010000:00010000:2.0:1790778796.050035:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.050082:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.050192:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548160:0@lo:501: 00000100:00100000:2.0:1790778796.050232:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.050359:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2209cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778796.050969:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531547904:12345-0@lo:13: Request processed in 6055us (7125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778796.050982:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790778796.052868:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d76300 x1877767531547904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778796.052899:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531547904:0@lo:13: 00000100:00100000:3.0:1790778796.057967:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548160 00000100:00100000:3.0:1790778796.057990:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548160 00000100:00100000:3.0:1790778796.059717:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790778796.059751:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531548160:12345-0@lo:501: 00000100:00100000:3.0:1790778796.060957:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531548160:12345-0@lo:501: Request processed in 1217us (10717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.060969:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790778796.065494:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548160:0@lo:501: 00000100:00100000:2.0:1790778796.065567:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548288:0@lo:503: 00000100:00100000:2.0:1790778796.065654:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.065790:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2209cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.065848:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548288 00000100:00100000:1.0:1790778796.065859:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548288 00000100:00100000:1.0:1790778796.065977:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790778796.065987:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531548288:12345-0@lo:503: 00000100:00100000:1.0:1790778796.066427:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531548288:12345-0@lo:503: Request processed in 439us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.066436:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790778796.066618:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548288:0@lo:503: 00000100:00100000:1.0:1790778796.067079:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8469:1877767531548416:0@lo:502: 00000100:00100000:1.0:1790778796.067425:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.067557:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.067856:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548416 00000100:00100000:2.0:1790778796.067865:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548416 00000100:00100000:2.0:1790778796.067955:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790778796.067965:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8469:x1877767531548416:12345-0@lo:502: 00000100:00100000:2.0:1790778796.068160:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8469:x1877767531548416:12345-0@lo:502: Request processed in 195us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.068168:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790778796.069800:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8469:1877767531548416:0@lo:502: 00000100:00100000:1.0:1790778796.069891:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8469:1877767531548544:0@lo:502: 00000100:00100000:1.0:1790778796.069956:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.070010:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.070962:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548544 00000100:00100000:2.0:1790778796.070984:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548544 00000100:00100000:2.0:1790778796.071058:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790778796.071069:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8469:x1877767531548544:12345-0@lo:502: 00000100:00100000:2.0:1790778796.071355:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8469:x1877767531548544:12345-0@lo:502: Request processed in 288us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.071364:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790778796.071542:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8469:1877767531548544:0@lo:502: 00000040:00080000:1.0:1790778796.071579:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790778796.072248:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790778796.072280:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778796.072295:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.072311:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778796.072323:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790778796.072326:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1790778796.072330:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790778796.072374:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.072381:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.072391:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.072413:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548672:0@lo:101: 00000100:00100000:2.0:1790778796.072518:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.072561:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.072722:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548672 00000100:00100000:1.0:1790778796.072729:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548672 00000100:00100000:1.0:1790778796.072761:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790778796.072769:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531548672:12345-0@lo:101: 00010000:00010000:1.0:1790778796.072781:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778796.072793:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560747d2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.072815:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560747d2 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.072838:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747d2 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.072846:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa200, rc 0) 00000100:00100000:1.0:1790778796.072887:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531548672:12345-0@lo:101: Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.072894:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790778796.073060:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548672:0@lo:101: 00010000:00010000:2.0:1790778796.073084:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.073094:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.075999:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548800:0@lo:501: 00000100:00100000:2.0:1790778796.076089:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.076201:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.079913:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548800 00000100:00100000:1.0:1790778796.079933:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548800 00000100:00100000:1.0:1790778796.080004:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790778796.080013:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531548800:12345-0@lo:501: 00000100:00100000:1.0:1790778796.080839:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531548800:12345-0@lo:501: Request processed in 824us (4747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.080849:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790778796.082350:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548800:0@lo:501: 00000100:00100000:2.0:1790778796.082760:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548928:0@lo:503: 00000100:00100000:2.0:1790778796.082861:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.082999:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.084112:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531548928 00000100:00100000:3.0:1790778796.084126:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531548928 00000100:00100000:3.0:1790778796.084562:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790778796.084574:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531548928:12345-0@lo:503: 00000100:00100000:3.0:1790778796.084862:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531548928:12345-0@lo:503: Request processed in 290us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.084872:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790778796.085032:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531548928:0@lo:503: 00000100:00100000:0.0:1790778796.085596:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8470:1877767531549056:0@lo:502: 00000100:00100000:0.0:1790778796.085661:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778796.089471:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.090087:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549056 00000100:00100000:1.0:1790778796.090101:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549056 00000100:00100000:1.0:1790778796.090182:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790778796.090193:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:8470:x1877767531549056:12345-0@lo:502: 00000100:00100000:1.0:1790778796.090390:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:8470:x1877767531549056:12345-0@lo:502: Request processed in 198us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.090399:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790778796.090461:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8470:1877767531549056:0@lo:502: 00000020:01000000:3.0:1790778796.090555:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778796.090567:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778796.090570:0:8470:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790778796.090577:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790778796.090579:0:8470:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790778796.090698:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8470:1877767531549184:0@lo:502: 00000100:00100000:3.0:1790778796.090749:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778796.090966:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778796.091011:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549184 00000100:00100000:0.0:1790778796.091017:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549184 00000100:00100000:0.0:1790778796.091200:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790778796.091209:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:8470:x1877767531549184:12345-0@lo:502: 00000100:00100000:0.0:1790778796.091462:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:8470:x1877767531549184:12345-0@lo:502: Request processed in 254us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778796.091475:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790778796.091552:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8470:1877767531549184:0@lo:502: 00000020:01000000:3.0:1790778796.091573:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778796.091578:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778796.091585:0:8470:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790778796.091588:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1790778796.092289:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1790778796.092316:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790778796.092327:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.092339:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778796.092350:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790778796.092354:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef211145000 from 30 10000000:01000000:2.0:1790778796.092357:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790778796.092388:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.092397:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.092414:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.092432:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549312:0@lo:101: 00000100:00100000:2.0:1790778796.092515:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778796.092552:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549312 00000100:00100000:2.0:1790778796.092553:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.092559:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549312 00000100:00100000:3.0:1790778796.092669:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790778796.092681:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531549312:12345-0@lo:101: 00010000:00010000:3.0:1790778796.092693:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778796.092705:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560747e0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778796.092727:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560747e0 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778796.092738:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747e0 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778796.092746:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201498800, rc 0) 00000100:00100000:3.0:1790778796.092940:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531549312:12345-0@lo:101: Request processed in 261us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.092949:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790778796.093010:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549312:0@lo:101: 00010000:00010000:1.0:1790778796.093027:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.093036:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778796.093582:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549440:0@lo:501: 00000100:00100000:1.0:1790778796.093694:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.093763:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206bea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.093912:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549440 00000100:00100000:3.0:1790778796.093920:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549440 00000100:00100000:3.0:1790778796.093996:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790778796.094006:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531549440:12345-0@lo:501: 00000100:00100000:3.0:1790778796.094199:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531549440:12345-0@lo:501: Request processed in 195us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.094207:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790778796.094274:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549440:0@lo:501: 00000100:00100000:2.0:1790778796.094311:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549568:0@lo:503: 00000100:00100000:2.0:1790778796.094355:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.099680:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549568 00000100:00100000:1.0:1790778796.099702:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549568 00000100:00100000:1.0:1790778796.099771:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790778796.099958:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531549568:12345-0@lo:503: 00000100:00100000:1.0:1790778796.100564:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531549568:12345-0@lo:503: Request processed in 609us (6206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.100575:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790778796.100834:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.100863:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549568:0@lo:503: 00000100:00100000:1.0:1790778796.107149:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8471:1877767531549696:0@lo:502: 00000100:00100000:1.0:1790778796.107248:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.107318:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206bea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.107501:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549696 00000100:00100000:3.0:1790778796.107509:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549696 00000100:00100000:3.0:1790778796.107558:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790778796.107566:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:8471:x1877767531549696:12345-0@lo:502: 00000100:00100000:3.0:1790778796.109525:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:8471:x1877767531549696:12345-0@lo:502: Request processed in 1951us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.109538:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790778796.109779:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8471:1877767531549696:0@lo:502: 00000100:00100000:1.0:1790778796.110187:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8471:1877767531549824:0@lo:502: 00000100:00100000:1.0:1790778796.110252:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778796.110413:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549824 00000100:00100000:3.0:1790778796.110420:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549824 00000100:00100000:1.0:1790778796.110433:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206bea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.110577:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790778796.110586:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:8471:x1877767531549824:12345-0@lo:502: 00000100:00100000:3.0:1790778796.110746:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:8471:x1877767531549824:12345-0@lo:502: Request processed in 160us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.110754:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790778796.110777:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8471:1877767531549824:0@lo:502: 00000040:00080000:1.0:1790778796.110868:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790778796.111163:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790778796.111187:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778796.111201:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.111212:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778796.111223:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790778796.111226:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef211145000 from 5 10000000:01000000:2.0:1790778796.111228:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790778796.111402:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.111412:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.111437:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.111541:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549952:0@lo:101: 00000100:00100000:2.0:1790778796.111584:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.111626:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778796.112038:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531549952 00000100:00100000:0.0:1790778796.112053:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531549952 00000100:00100000:0.0:1790778796.112113:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790778796.112124:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531549952:12345-0@lo:101: 00010000:00010000:0.0:1790778796.112687:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778796.112708:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a1000/0xdc876326560747f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560747ee expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778796.112736:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a1000/0xdc876326560747f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560747ee expref: 17 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778796.112748:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a1000/0xdc876326560747f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747ee expref: 17 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778796.112757:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1000, rc 0) 00000100:00100000:0.0:1790778796.112863:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531549952:12345-0@lo:101: Request processed in 741us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778796.112871:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790778796.112948:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531549952:0@lo:101: 00010000:00010000:2.0:1790778796.112966:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.112975:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.113036:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550080:0@lo:256: 00000100:00100000:2.0:1790778796.113086:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.113167:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.113262:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550080 00000100:00100000:3.0:1790778796.113269:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550080 00000100:00100000:3.0:1790778796.113347:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790778796.113356:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531550080:12345-0@lo:256: 20000000:01000000:3.0:1790778796.113370:0:5943:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790778796.113387:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790778796.113390:0:5943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790778796.113534:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531550080:12345-0@lo:256: Request processed in 179us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.113541:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790778796.113673:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550080:0@lo:256: 10000000:01000000:1.0:1790778796.113721:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790778796.113729:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.113747:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778796.113757:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790778796.113759:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790778796.113762:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790778796.113783:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.113790:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.113800:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778796.113813:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550208:0@lo:101: 00000100:00100000:1.0:1790778796.113841:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.119287:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206bea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.119567:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550208 00000100:00100000:2.0:1790778796.119580:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550208 00000100:00100000:2.0:1790778796.119651:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790778796.119661:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531550208:12345-0@lo:101: 00010000:00010000:2.0:1790778796.119682:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778796.119705:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560747fc expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.119743:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560747fc expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.119781:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747fc expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.119805:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165be00, rc 0) 00000100:00100000:2.0:1790778796.119925:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531550208:12345-0@lo:101: Request processed in 265us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.119933:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790778796.120406:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550208:0@lo:101: 00010000:00010000:1.0:1790778796.120427:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.120437:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.120632:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550336:0@lo:501: 00000100:00100000:2.0:1790778796.120673:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.120706:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550336 00000100:00100000:2.0:1790778796.120709:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.120712:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550336 00000100:00100000:1.0:1790778796.120751:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790778796.120768:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531550336:12345-0@lo:501: 00000100:00100000:1.0:1790778796.120969:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531550336:12345-0@lo:501: Request processed in 202us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.120976:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790778796.121026:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550336:0@lo:501: 00000100:00100000:2.0:1790778796.121064:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550464:0@lo:503: 00000100:00100000:2.0:1790778796.121108:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778796.121246:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550464 00000100:00100000:3.0:1790778796.121250:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550464 00000100:00100000:3.0:1790778796.121283:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790778796.121291:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531550464:12345-0@lo:503: 00000100:00100000:3.0:1790778796.121370:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531550464:12345-0@lo:503: Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.121383:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790778796.121429:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.121463:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531550464:0@lo:503: 00000100:00100000:2.0:1790778796.122025:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8472:1877767531550592:0@lo:502: 00000100:00100000:2.0:1790778796.122070:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.122143:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.122274:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550592 00000100:00100000:1.0:1790778796.122280:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550592 00000100:00100000:1.0:1790778796.122347:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790778796.122355:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:8472:x1877767531550592:12345-0@lo:502: 00000100:00100000:1.0:1790778796.122502:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:8472:x1877767531550592:12345-0@lo:502: Request processed in 148us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.122507:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790778796.122576:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8472:1877767531550592:0@lo:502: 00000020:01000000:2.0:1790778796.122598:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790778796.122606:0:8472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790778796.122613:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778796.122615:0:8472:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790778796.122620:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790778796.122624:0:8472:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:2.0:1790778796.122652:0:8472:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790778796.122656:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790778796.122672:0:8472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ef23b9a3380) 00000020:00000080:2.0:1790778796.122692:0:8472:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790778796.122697:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790778796.122786:0:8472:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790778796.122792:0:8472:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790778796.122800:0:8472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc87632656074811 00010000:00080000:2.0:1790778796.122839:0:8472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef235dc4000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1790778796.123083:0:8472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790778796.123235:0:8472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790778796.123246:0:8472:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790778796.123415:0:8472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778796.123597:0:8472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790778796.123724:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790778796.123814:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790778796.124366:0:8473:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778796.124371:0:8473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790778796.124986:0:8472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790778796.124997:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790778796.125032:0:8472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790778796.125067:0:8472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656074818 00000100:00080000:2.0:1790778796.125076:0:8472:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790778796.125087:0:8472:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef235dc4000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778796.125120:0:8472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2201aea00 x1877767531550720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790778796.125330:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531550720:0@lo:8: 00000100:00100000:0.0:1790778796.125397:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790778796.125670:0:8472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790778796.125733:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778796.125738:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778796.125740:0:8472:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790778796.125751:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778796.125755:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778796.125756:0:8472:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790778796.125759:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790778796.125761:0:8472:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790778796.125787:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8472:1877767531550848:0@lo:502: 00000100:00100000:2.0:1790778796.125834:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.125853:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef208b36240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.125973:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778796.125986:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531550976:0@lo:400: 00000100:00100000:3.0:1790778796.126020:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778796.126065:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531551104:0@lo:400: 00000100:00100000:3.0:1790778796.126094:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778796.126119:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778796.126126:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531551232:0@lo:400: 00000100:00100000:1.0:1790778796.126132:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550848 00000100:00100000:1.0:1790778796.126142:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550848 00000100:00100000:1.0:1790778796.126156:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550720 00000100:00100000:1.0:1790778796.126159:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550720 00000100:00100000:1.0:1790778796.126195:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778796.126202:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3438:x1877767531550720:12345-0@lo:8: 00010000:00080000:1.0:1790778796.126231:0:6935:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000100:00100000:3.0:1790778796.126328:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.126421:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531550976 00000100:00100000:2.0:1790778796.126426:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531550976 00000100:00100000:2.0:1790778796.126481:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551104 00000100:00100000:2.0:1790778796.126485:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551104 00000100:00100000:3.0:1790778796.126579:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551232 00000100:00100000:3.0:1790778796.126584:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551232 00000100:00100000:3.0:1790778796.126626:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000020:00000080:1.0:1790778796.126628:0:6935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc8763265607481f 00000100:00100000:3.0:1790778796.126634:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531550976:12345-0@lo:400: 00002000:00100000:1.0:1790778796.126650:0:6935:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ef236260800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790778796.126656:0:6935:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1790778796.126662:0:6935:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1790778796.126699:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531550976:12345-0@lo:400: Request processed in 65us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.126706:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790778796.126725:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790778796.126732:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531551232:12345-0@lo:400: 00002000:00100000:1.0:1790778796.126763:0:6935:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1790778796.126769:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531551232:12345-0@lo:400: Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778796.126774:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790778796.126819:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c03480 x1877767531550976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778796.126831:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531550976:0@lo:400: 00010000:00080000:3.0:1790778796.126864:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c01180 x1877767531551232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778796.126886:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531551232:0@lo:400: 00000100:00100000:2.0:1790778796.126954:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790778796.126963:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531551104:12345-0@lo:400: 00000100:00100000:2.0:1790778796.127340:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531551104:12345-0@lo:400: Request processed in 378us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.127347:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1790778796.127425:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c00a80 x1877767531551104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778796.127435:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531551104:0@lo:400: 00000100:00080000:0.0:1790778796.127776:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1790778796.129093:0:6935:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790778796.129143:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef236267000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778796.129256:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3438:x1877767531550720:12345-0@lo:8: Request processed in 3050us (3855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.129287:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778796.129490:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790778796.129506:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:8472:x1877767531550848:12345-0@lo:502: 00000100:00100000:2.0:1790778796.129770:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:8472:x1877767531550848:12345-0@lo:502: Request processed in 270us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.129779:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790778796.129876:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8472:1877767531550848:0@lo:502: 00000020:01000000:1.0:1790778796.129910:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778796.129917:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778796.129920:0:8472:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790778796.129926:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:0.0:1790778796.130406:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201aea00 x1877767531550720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790778806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778796.130418:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790778796.130426:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790778796.130436:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790778796.130468:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790778796.130473:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef235dc4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790778796.130494:0:3438:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790778796.130500:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531550720:0@lo:8: 00000004:00080000:2.0:1790778796.130788:0:8473:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790778796.130860:0:8473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 190006417382ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790778796.130867:0:8473:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1790778796.131355:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1790778796.131389:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790778796.131402:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.131417:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778796.131457:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790778796.131460:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef2201619c0 from 1 10000000:01000000:2.0:1790778796.131464:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790778796.131500:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.131507:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.131516:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.131535:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531551360:0@lo:101: 00000100:00100000:2.0:1790778796.131585:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.131626:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551360 00000100:00100000:1.0:1790778796.131636:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551360 00000100:00100000:2.0:1790778796.131641:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef208b36240 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.131698:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790778796.131712:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531551360:12345-0@lo:101: 00010000:00010000:1.0:1790778796.131733:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778796.131754:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074826 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.131792:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074826 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.131807:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074826 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778796.131818:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abe00, rc 0) 00000100:00100000:1.0:1790778796.131874:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531551360:12345-0@lo:101: Request processed in 163us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.131882:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790778796.132418:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531551360:0@lo:101: 00010000:00010000:2.0:1790778796.132432:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.132454:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778796.132512:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531551488:0@lo:501: 00000100:00100000:2.0:1790778796.132537:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.132977:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef208b36240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.133138:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551488 00000100:00100000:3.0:1790778796.133145:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551488 00000100:00100000:3.0:1790778796.133200:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790778796.133208:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531551488:12345-0@lo:501: 00000100:00100000:3.0:1790778796.133725:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531551488:12345-0@lo:501: Request processed in 514us (1182us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790778796.133737:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790778796.134122:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531551488:0@lo:501: 10000000:01000000:2.0:1790778796.134406:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790778796.134437:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778796.134476:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790778796.139863:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1790778796.143813:0:8474:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790778796.143851:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531551744:0@lo:7: 00000100:00100000:0.0:1790778796.143939:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778796.143977:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245a240 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.144096:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778796.144116:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531551616:0@lo:13: 00000100:00100000:2.0:1790778796.144154:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778796.144214:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551616 00000100:00100000:0.0:1790778796.144223:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551616 00000100:00100000:0.0:1790778796.144437:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790778796.144476:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531551616:12345-0@lo:13: 00002000:00000024:0.0:1790778796.144830:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1790778796.144889:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531551616:12345-0@lo:13: Request processed in 417us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778796.144896:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790778796.145430:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551744 00000100:00100000:3.0:1790778796.145439:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551744 00000100:00100000:3.0:1790778796.145519:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790778796.145529:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8474:x1877767531551744:12345-0@lo:7: 00000100:00080000:2.0:1790778796.146143:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790778796.146203:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205bb2680 x1877767531551616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778796.146232:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531551616:0@lo:13: 00002000:00080000:2.0:1790778796.149849:0:6934:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790778796.149859:0:6934:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790778796.149979:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8474:x1877767531551744:12345-0@lo:7: Request processed in 4448us (6036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.149993:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790778796.150015:0:8474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205bb1180 x1877767531551744/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790778812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778796.150034:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531551744:0@lo:7: 00000004:00080000:0.0:1790778796.150060:0:8474:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790778796.150099:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531551872:0@lo:5: 00000100:00100000:0.0:1790778796.150136:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778796.150169:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245a240 going to sleep for 11 seconds 00000100:00100000:1.0:1790778796.150229:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531551872 00000100:00100000:1.0:1790778796.150251:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531551872 00000100:00100000:1.0:1790778796.150307:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790778796.150317:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8474:x1877767531551872:12345-0@lo:5: 00002000:00080000:1.0:1790778796.150344:0:6937:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790778796.150348:0:6937:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1790778796.155988:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1790778796.156012:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790778796.156360:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8474:x1877767531551872:12345-0@lo:5: Request processed in 6038us (6216us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790778796.156373:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790778796.158656:0:8474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205bb1180 x1877767531551872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778796.158671:0:8474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790778796.158698:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531551872:0@lo:5: 00000004:00080000:0.0:1790778796.158716:0:8474:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790778796.158782:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531552000:0@lo:700: 00000100:00100000:0.0:1790778796.158844:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778796.158888:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21245a240 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.159062:0:6943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552000 00000100:00100000:2.0:1790778796.159070:0:6943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552000 00000100:00100000:2.0:1790778796.159129:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790778796.159139:0:6943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8474:x1877767531552000:12345-0@lo:700: 00000100:00100000:2.0:1790778796.159180:0:6943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6943:1877767531552128:0@lo:700: 00000100:00100000:2.0:1790778796.159213:0:6943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778796.159247:0:6943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef208b36240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778796.159397:0:5956:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552128 00000100:00100000:3.0:1790778796.159403:0:5956:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552128 00000100:00100000:3.0:1790778796.159465:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790778796.159473:0:5956:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6943:x1877767531552128:12345-0@lo:700: 40000000:02000000:3.0:1790778796.169018:0:5956:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790778796.175364:0:5956:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6943:x1877767531552128:12345-0@lo:700: Request processed in 15882us (16139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778796.175398:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790778796.175406:0:6943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201af480 x1877767531552128/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790778812 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778796.175426:0:6943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6943:1877767531552128:0@lo:700: 40000000:02000000:0.0:1790778796.175484:0:6943:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1790778796.193232:0:6943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8474:x1877767531552000:12345-0@lo:700: Request processed in 34083us (34376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778796.193262:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790778796.193461:0:8474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205bb1180 x1877767531552000/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790778812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778796.193476:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531552000:0@lo:700: 00000004:02000040:0.0:1790778796.200938:0:8474:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1790778796.206596:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531552256:0@lo:5: 00000100:00100000:1.0:1790778796.206777:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778796.206893:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206beab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778796.207224:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552256 00000100:00100000:2.0:1790778796.207241:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552256 00000100:00100000:2.0:1790778796.207473:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790778796.207495:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8474:x1877767531552256:12345-0@lo:5: 00002000:00080000:2.0:1790778796.215142:0:6934:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790778796.215169:0:6934:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790778796.218487:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8474:x1877767531552256:12345-0@lo:5: Request processed in 10999us (11704us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790778796.218501:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790778796.218519:0:8474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205bb1180 x1877767531552256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790778812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778796.218791:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8474:1877767531552256:0@lo:5: 00000004:00080000:1.0:1790778796.218808:0:8474:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1790778796.814094:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790778796.858598:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000020:00000004:1.0:1790778797.781987:0:8525:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778797.782384:0:8525:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790778797.838216:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790778798.660233:0:8573:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778798.660244:0:8573:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1790778798.860218:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778799.885464:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778800.076536:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.076635:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557056 00000100:00100000:3.0:1790778800.076647:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557056 00000100:00100000:3.0:1790778800.076694:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:3.0:1790778800.076703:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2342:x1877767510557056:12345-192.168.202.2@tcp:250: 00010000:00080000:3.0:1790778800.076733:0:5943:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 60d2500a-b265-416e-aebe-5cbe8594cb7d@192.168.202.2@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1790778800.076762:0:5943:0:(genops.c:1384:class_connect()) connect: client 60d2500a-b265-416e-aebe-5cbe8594cb7d, cookie 0xdc87632656074834 00000100:00080000:3.0:1790778800.076904:0:5943:0:(import.c:65:import_set_state_nolock()) ffff9ef235882800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778800.076979:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+5:2342:x1877767510557056:12345-192.168.202.2@tcp:250: Request processed in 275us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778800.076987:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:0.0:1790778800.081324:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.081527:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510556928 00000100:00100000:3.0:1790778800.081537:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510556928 00000100:00100000:3.0:1790778800.081700:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:3.0:1790778800.081712:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+5:5423:x1877767510556928:12345-192.168.202.2@tcp:101: 00010000:00010000:3.0:1790778800.081731:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778800.081750:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dca8a expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.081783:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 6 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.081796:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 6 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.081806:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201499e00, rc 0) 00000100:00100000:3.0:1790778800.081905:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+6:5423:x1877767510556928:12345-192.168.202.2@tcp:101: Request processed in 195us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778800.081913:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:0.0:1790778800.085183:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778800.085321:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557184 00000100:00100000:1.0:1790778800.085331:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557184 00000100:00100000:1.0:1790778800.085539:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1790778800.085552:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+6:5423:x1877767510557184:12345-192.168.202.2@tcp:501: 00000100:00100000:1.0:1790778800.085686:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+6:5423:x1877767510557184:12345-192.168.202.2@tcp:501: Request processed in 137us (512us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790778800.085709:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:0.0:1790778800.088708:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.088827:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557312 00000100:00100000:3.0:1790778800.088838:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557312 00000100:00100000:3.0:1790778800.088894:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:3.0:1790778800.088904:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+6:5423:x1877767510557312:12345-192.168.202.2@tcp:101: 00010000:00010000:3.0:1790778800.088918:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778800.088937:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dca91 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.088977:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 7 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.088990:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 7 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.088999:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201498c00, rc 0) 00000100:00100000:3.0:1790778800.089066:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+7:5423:x1877767510557312:12345-192.168.202.2@tcp:101: Request processed in 164us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778800.089074:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:0.0:1790778800.094034:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778800.094296:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557440 00000100:00100000:1.0:1790778800.094306:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557440 00000100:00100000:1.0:1790778800.094356:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1790778800.094363:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+7:5423:x1877767510557440:12345-192.168.202.2@tcp:501: 00000100:00100000:1.0:1790778800.094572:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5423:x1877767510557440:12345-192.168.202.2@tcp:501: Request processed in 208us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778800.094580:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:0.0:1790778800.098821:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778800.099064:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557568 00000100:00100000:2.0:1790778800.099078:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557568 00000100:00100000:2.0:1790778800.099143:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:2.0:1790778800.099155:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5423:x1877767510557568:12345-192.168.202.2@tcp:503: 00000100:00100000:2.0:1790778800.099337:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5423:x1877767510557568:12345-192.168.202.2@tcp:503: Request processed in 184us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778800.099346:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1790778800.107691:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.108861:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557696 00000100:00100000:3.0:1790778800.108875:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557696 00000100:00100000:3.0:1790778800.108943:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:3.0:1790778800.108954:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5442:x1877767510557696:12345-192.168.202.2@tcp:502: 00000100:00100000:3.0:1790778800.109350:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5442:x1877767510557696:12345-192.168.202.2@tcp:502: Request processed in 396us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778800.109359:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:0.0:1790778800.151284:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778800.151396:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557824 00000100:00100000:1.0:1790778800.151417:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557824 00000100:00100000:1.0:1790778800.151523:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:1.0:1790778800.151534:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5442:x1877767510557824:12345-192.168.202.2@tcp:502: 00000100:00100000:1.0:1790778800.151717:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5442:x1877767510557824:12345-192.168.202.2@tcp:502: Request processed in 183us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778800.151725:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:0.0:1790778800.160505:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.161094:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510557952 00000100:00100000:3.0:1790778800.161104:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510557952 00000100:00100000:3.0:1790778800.161147:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1790778800.161167:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5423:x1877767510557952:12345-192.168.202.2@tcp:101: 00010000:00010000:3.0:1790778800.161183:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778800.161200:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201499600/0xdc87632656074849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcabb expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.161223:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499600/0xdc87632656074849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcabb expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.161231:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201499600/0xdc87632656074849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcabb expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778800.161237:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201499600, rc 0) 00000100:00100000:3.0:1790778800.161289:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5423:x1877767510557952:12345-192.168.202.2@tcp:101: Request processed in 122us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778800.161294:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:0.0:1790778800.174044:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778800.174154:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558080 00000100:00100000:2.0:1790778800.174165:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558080 00000100:00100000:2.0:1790778800.174226:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:2.0:1790778800.174237:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5423:x1877767510558080:12345-192.168.202.2@tcp:256: 20000000:01000000:2.0:1790778800.174263:0:5943:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790778800.174286:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790778800.174290:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790778800.174293:0:5943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790778800.174296:0:5943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790778800.178304:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5423:x1877767510558080:12345-192.168.202.2@tcp:256: Request processed in 4056us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778800.178322:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:0.0:1790778800.181891:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778800.181984:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558208 00000100:00100000:1.0:1790778800.181994:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558208 00000100:00100000:1.0:1790778800.182061:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:1.0:1790778800.182071:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5423:x1877767510558208:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1790778800.182087:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778800.182104:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcac2 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778800.182136:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778800.182171:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778800.182182:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:1.0:1790778800.182251:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5423:x1877767510558208:12345-192.168.202.2@tcp:101: Request processed in 181us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778800.182258:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:0.0:1790778800.186157:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778800.186302:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558336 00000100:00100000:2.0:1790778800.186317:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558336 00000100:00100000:2.0:1790778800.186388:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:2.0:1790778800.186411:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5423:x1877767510558336:12345-192.168.202.2@tcp:501: 00000100:00100000:2.0:1790778800.186869:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5423:x1877767510558336:12345-192.168.202.2@tcp:501: Request processed in 470us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778800.186878:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:0.0:1790778800.189900:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.189999:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558464 00000100:00100000:3.0:1790778800.190020:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558464 00000100:00100000:3.0:1790778800.190099:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:3.0:1790778800.190110:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5423:x1877767510558464:12345-192.168.202.2@tcp:503: 00000100:00100000:3.0:1790778800.190308:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5423:x1877767510558464:12345-192.168.202.2@tcp:503: Request processed in 199us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778800.190317:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:0.0:1790778800.196607:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778800.196756:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558592 00000100:00100000:2.0:1790778800.196766:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558592 00000100:00100000:2.0:1790778800.196821:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:2.0:1790778800.196830:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5447:x1877767510558592:12345-192.168.202.2@tcp:502: 00000100:00100000:2.0:1790778800.196986:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5447:x1877767510558592:12345-192.168.202.2@tcp:502: Request processed in 156us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778800.196994:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:0.0:1790778800.200127:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778800.200288:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558720 00000100:00100000:1.0:1790778800.200301:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558720 00000100:00100000:1.0:1790778800.200367:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:1.0:1790778800.200378:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5447:x1877767510558720:12345-192.168.202.2@tcp:502: 00000100:00100000:1.0:1790778800.200603:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5447:x1877767510558720:12345-192.168.202.2@tcp:502: Request processed in 226us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778800.200613:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:0.0:1790778800.205275:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778800.205354:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558848 00000100:00100000:3.0:1790778800.205365:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558848 00000100:00100000:3.0:1790778800.205423:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1790778800.205432:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2342:x1877767510558848:12345-192.168.202.2@tcp:38: 00010000:00080000:3.0:1790778800.205495:0:5951:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1790778800.205804:0:5951:0:(genops.c:1384:class_connect()) connect: client b53b344e-0d4c-4209-a606-d24036760c61, cookie 0xdc87632656074857 00000004:00100000:0.0:1790778800.205829:0:5951:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790778800.205835:0:5951:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1790778800.212509:0:5951:0:(import.c:65:import_set_state_nolock()) ffff9ef235dc0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790778800.212705:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2342:x1877767510558848:12345-192.168.202.2@tcp:38: Request processed in 7270us (7435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778800.212717:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00010000:00010000:3.0:1790778800.909014:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778801.164505:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531552512:0@lo:400: 00000100:00100000:0.0:1790778801.164505:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531552384:0@lo:13: 00000100:00100000:3.0:1790778801.164579:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531552640:0@lo:13: 00000100:00100000:2.0:1790778801.168801:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531552768:0@lo:400: 00000100:00100000:0.0:1790778801.173538:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778801.173650:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531552896:0@lo:400: 00000100:00100000:0.0:1790778801.173687:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778801.173735:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552384 00000100:00100000:0.0:1790778801.173744:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552384 00000100:00100000:0.0:1790778801.173797:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778801.173806:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531552384:12345-0@lo:13: 00002000:00000024:0.0:1790778801.173838:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778801.173886:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531552384:12345-0@lo:13: Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778801.173893:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790778801.173931:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552896 00000100:00100000:0.0:1790778801.173935:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552896 00000100:00100000:0.0:1790778801.173972:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790778801.173978:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531552896:12345-0@lo:400: 00000100:00100000:0.0:1790778801.174021:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531552896:12345-0@lo:400: Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778801.174273:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1790778801.174296:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790778801.174316:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778801.174351:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201adf80 x1877767531552896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778801.174366:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531552896:0@lo:400: 00010000:00080000:0.0:1790778801.174378:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c00a80 x1877767531552384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778801.174391:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531552384:0@lo:13: 00000100:00100000:1.0:1790778801.175013:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778801.175073:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531553024:0@lo:400: 00000100:00100000:1.0:1790778801.175104:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778801.175127:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778801.175134:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531553152:0@lo:400: 00000100:00100000:0.0:1790778801.175141:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552512 00000100:00100000:0.0:1790778801.175148:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552512 00000100:00100000:1.0:1790778801.175164:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778801.175181:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790778801.175189:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531552512:12345-0@lo:400: 00000100:00100000:1.0:1790778801.175193:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553024 00000100:00100000:1.0:1790778801.175196:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553024 00000100:00100000:1.0:1790778801.175225:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778801.175231:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531553024:12345-0@lo:400: 00000100:00100000:0.0:1790778801.175231:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531552512:12345-0@lo:400: Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778801.175237:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790778801.175272:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531553024:12345-0@lo:400: Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778801.175274:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553152 00000100:00100000:0.0:1790778801.175277:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553152 00000100:00100000:1.0:1790778801.175278:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778801.175306:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1790778801.175308:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201ac380 x1877767531553024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778801.175313:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531553152:12345-0@lo:400: 00000100:00100000:1.0:1790778801.175320:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531553024:0@lo:400: 00000100:00100000:1.0:1790778801.175329:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531552512:0@lo:400: 00000100:00100000:0.0:1790778801.175342:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531553152:12345-0@lo:400: Request processed in 29us (177us total) trans 0 rc 0/0 00010000:00080000:1.0:1790778801.175346:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201aca80 x1877767531553152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778801.175348:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778801.175355:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531553152:0@lo:400: 00000100:00080000:0.0:1790778801.175375:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778801.176181:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778801.178846:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778801.179986:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531553280:0@lo:400: 00000100:00100000:2.0:1790778801.180053:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778801.181434:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553280 00000100:00100000:1.0:1790778801.181497:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553280 00000100:00100000:1.0:1790778801.181597:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790778801.181608:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531553280:12345-0@lo:400: 00000100:00100000:1.0:1790778801.181705:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531553280:12345-0@lo:400: Request processed in 99us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.181713:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790778801.182252:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790778801.182328:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201af480 x1877767531553280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778801.182342:0:3441:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790778801.182368:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531553280:0@lo:400: 00000100:00100000:3.0:1790778801.187748:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552768 00000100:00100000:3.0:1790778801.187763:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552768 00000100:00100000:3.0:1790778801.187836:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790778801.187846:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531552768:12345-0@lo:400: 00000100:00100000:3.0:1790778801.188056:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531552768:12345-0@lo:400: Request processed in 211us (9216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778801.188063:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790778801.188094:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201ac700 x1877767531552768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778801.188111:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531552768:0@lo:400: 00000100:00100000:0.0:1790778801.191200:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531552640 00000100:00100000:0.0:1790778801.191230:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531552640 00000100:00100000:0.0:1790778801.191314:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790778801.191326:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531552640:12345-0@lo:13: 00002000:00000024:0.0:1790778801.191363:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778801.191487:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531552640:12345-0@lo:13: Request processed in 163us (15306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778801.191495:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790778801.191564:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d75c00 x1877767531552640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778801.191586:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531552640:0@lo:13: 00000100:00100000:0.0:1790778801.218334:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778801.218394:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778801.218497:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559104 00000100:00100000:1.0:1790778801.218510:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559104 00000100:00100000:1.0:1790778801.218588:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510558976 00000100:00100000:1.0:1790778801.218591:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510558976 00000100:00100000:1.0:1790778801.218610:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1790778801.218622:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:5423:x1877767510559104:12345-192.168.202.2@tcp:41: 00000004:00000024:1.0:1790778801.218670:0:5950:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1790778801.218750:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:5423:x1877767510559104:12345-192.168.202.2@tcp:41: Request processed in 129us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.218773:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1790778801.218791:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1790778801.218798:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:0:x1877767510558976:12345-192.168.202.2@tcp:41: 00000004:00000024:1.0:1790778801.218809:0:5950:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1790778801.218830:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:0:x1877767510558976:12345-192.168.202.2@tcp:41: Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.218836:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00080000:0.0:1790778801.219494:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778801.221326:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778801.221436:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559232 00000100:00100000:1.0:1790778801.221482:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559232 00000100:00100000:1.0:1790778801.221544:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1790778801.221555:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:5423:x1877767510559232:12345-192.168.202.2@tcp:40: 00000100:00100000:1.0:1790778801.221644:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:5423:x1877767510559232:12345-192.168.202.2@tcp:40: Request processed in 90us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.221651:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1790778801.225417:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778801.225558:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778801.225699:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559744 00000100:00100000:2.0:1790778801.225713:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559744 00000100:00100000:2.0:1790778801.225785:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:2.0:1790778801.225796:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2343:x1877767510559744:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1790778801.225882:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2343:x1877767510559744:12345-192.168.202.2@tcp:400: Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778801.225889:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:3.0:1790778801.228533:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778801.228575:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778801.229491:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559360 00000100:00100000:1.0:1790778801.229505:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559360 00000100:00100000:1.0:1790778801.229549:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559488 00000100:00100000:1.0:1790778801.229551:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559488 00000100:00100000:1.0:1790778801.229565:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1790778801.229572:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1877767510559360:12345-192.168.202.2@tcp:8: 00010000:00080000:1.0:1790778801.229604:0:6935:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1790778801.229651:0:6935:0:(genops.c:1384:class_connect()) connect: client b53b344e-0d4c-4209-a606-d24036760c61, cookie 0xdc8763265607485e 00002000:00100000:1.0:1790778801.229667:0:6935:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b53b344e-0d4c-4209-a606-d24036760c61/ffff9ef236264800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790778801.229707:0:6935:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790778801.229925:0:6935:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790778801.229978:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef236265000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778801.230065:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2342:x1877767510559360:12345-192.168.202.2@tcp:8: Request processed in 491us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.230074:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1790778801.230097:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1790778801.230103:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1877767510559488:12345-192.168.202.2@tcp:8: 00010000:00080000:1.0:1790778801.230120:0:6935:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1790778801.230138:0:6935:0:(genops.c:1384:class_connect()) connect: client b53b344e-0d4c-4209-a606-d24036760c61, cookie 0xdc87632656074865 00002000:00100000:1.0:1790778801.230143:0:6935:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b53b344e-0d4c-4209-a606-d24036760c61/ffff9ef236260000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790778801.230149:0:6935:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790778801.230268:0:6935:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790778801.230281:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef236265800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778801.230303:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2342:x1877767510559488:12345-192.168.202.2@tcp:8: Request processed in 199us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.230309:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1790778801.233665:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559616 00000100:00100000:1.0:1790778801.233684:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559616 00000100:00100000:1.0:1790778801.233813:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1790778801.233823:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:5423:x1877767510559616:12345-192.168.202.2@tcp:33: 00000004:00080000:1.0:1790778801.261547:0:5952:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27631us 00000004:00200000:0.0:1790778801.278279:0:5952:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790778801.278470:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:5423:x1877767510559616:12345-192.168.202.2@tcp:33: Request processed in 44641us (53056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778801.278483:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1790778801.459759:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778801.459825:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510559872 00000100:00100000:1.0:1790778801.459837:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510559872 00000100:00100000:1.0:1790778801.459911:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1790778801.459947:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:5464:x1877767510559872:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1790778801.459975:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778801.460225:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607486c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcaec expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778801.460293:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074873 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778801.460307:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778801.460322:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778801.460370:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790778801.460374:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778801.460389:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778801.460416:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607486c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcaec expref: 8 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778801.460433:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcaec expref: 7 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778801.460714:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef215c54b00) 00010000:00010000:1.0:1790778801.460719:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778801.460723:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:1.0:1790778801.460791:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:5464:x1877767510559872:12345-192.168.202.2@tcp:101: Request processed in 856us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778801.460808:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:1.0:1790778801.934789:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778802.956019:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778803.692543:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778803.692715:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560000 00000100:00100000:1.0:1790778803.692725:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560000 00000100:00100000:1.0:1790778803.692787:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1790778803.692797:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:5517:x1877767510560000:12345-192.168.202.2@tcp:41: 00000004:00000024:1.0:1790778803.692834:0:5950:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1790778803.692894:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:5517:x1877767510560000:12345-192.168.202.2@tcp:41: Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778803.692901:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:0.0:1790778803.692958:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778803.697715:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778803.697820:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560128 00000100:00100000:2.0:1790778803.697830:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560128 00000100:00100000:2.0:1790778803.697919:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1790778803.697931:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b53b344e-0d4c-4209-a606-d24036760c61+6:5517:x1877767510560128:12345-192.168.202.2@tcp:13: 00002000:00000024:2.0:1790778803.697980:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778803.698056:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b53b344e-0d4c-4209-a606-d24036760c61+6:5517:x1877767510560128:12345-192.168.202.2@tcp:13: Request processed in 127us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778803.698064:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00080000:0.0:1790778803.698144:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778803.700337:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778803.700431:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560256 00000100:00100000:2.0:1790778803.700439:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560256 00000100:00100000:2.0:1790778803.700598:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790778803.700608:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b53b344e-0d4c-4209-a606-d24036760c61+6:5517:x1877767510560256:12345-192.168.202.2@tcp:13: 00002000:00000024:2.0:1790778803.700639:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778803.700704:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b53b344e-0d4c-4209-a606-d24036760c61+6:5517:x1877767510560256:12345-192.168.202.2@tcp:13: Request processed in 97us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778803.700712:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:0.0:1790778803.702703:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790778803.980094:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790778804.245496:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00010000:00010000:1.0:1790778805.005468:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778806.029160:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778806.284086:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531553408:0@lo:400: 00000100:00100000:1.0:1790778806.284219:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778806.284353:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553408 00000100:00100000:1.0:1790778806.284363:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553408 00000100:00100000:1.0:1790778806.284432:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790778806.284478:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531553408:12345-0@lo:400: 00000100:00100000:1.0:1790778806.284551:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531553408:12345-0@lo:400: Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778806.284561:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790778806.284633:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531553408:0@lo:400: 00000100:00100000:3.0:1790778806.285512:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531553664:0@lo:400: 00000100:00100000:3.0:1790778806.285583:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778806.285621:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778806.285628:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531553536:0@lo:400: 00000100:00100000:3.0:1790778806.285653:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778806.285694:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553664 00000100:00100000:3.0:1790778806.285701:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553664 00000100:00100000:3.0:1790778806.285776:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553536 00000100:00100000:3.0:1790778806.285780:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553536 00000100:00100000:3.0:1790778806.285806:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790778806.285815:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531553664:12345-0@lo:400: 00000100:00100000:3.0:1790778806.285869:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531553664:12345-0@lo:400: Request processed in 54us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778806.285876:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790778806.285893:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778806.285900:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531553536:12345-0@lo:400: 00000100:00100000:3.0:1790778806.285927:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531553536:12345-0@lo:400: Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778806.285934:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1790778806.285971:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778806.285998:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531553792:0@lo:13: 00000100:00100000:3.0:1790778806.286034:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778806.286085:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553792 00000100:00100000:3.0:1790778806.286089:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553792 00000100:00100000:3.0:1790778806.286126:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790778806.286523:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531553536:0@lo:400: 00000100:00100000:2.0:1790778806.286539:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531553664:0@lo:400: 00000100:00100000:2.0:1790778806.286574:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531554176:0@lo:400: 00000100:00100000:0.0:1790778806.286574:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531554048:0@lo:400: 00000100:00100000:2.0:1790778806.286616:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778806.286616:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778806.286646:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778806.286652:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531553920:0@lo:400: 00000100:00100000:0.0:1790778806.286683:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778806.287356:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531554176 00000100:00100000:2.0:1790778806.287365:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531554176 00000100:00100000:2.0:1790778806.287422:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531553920 00000100:00100000:2.0:1790778806.287426:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531553920 00000100:00100000:2.0:1790778806.287469:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778806.287479:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531554176:12345-0@lo:400: 00000100:00100000:3.0:1790778806.287724:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531553792:12345-0@lo:13: 00002000:00000024:3.0:1790778806.287762:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778806.287813:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531554176:12345-0@lo:400: Request processed in 336us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778806.287821:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778806.287840:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790778806.287845:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531553920:12345-0@lo:400: 00000100:00100000:3.0:1790778806.288477:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531553792:12345-0@lo:13: Request processed in 750us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778806.288487:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790778806.288522:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778806.288529:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778806.288635:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c00a80 x1877767531553792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778806.288666:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531553792:0@lo:13: 00000100:00100000:3.0:1790778806.288739:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531554048 00000100:00100000:3.0:1790778806.288747:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531554048 00000100:00100000:3.0:1790778806.288815:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778806.288824:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531554048:12345-0@lo:400: 00000100:00100000:3.0:1790778806.288877:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531554048:12345-0@lo:400: Request processed in 54us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778806.288883:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778806.288924:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531554048:0@lo:400: 00000100:00100000:1.0:1790778806.289294:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778806.289316:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531554304:0@lo:13: 00000100:00100000:1.0:1790778806.289391:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790778806.289485:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790778806.289506:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e38a80 x1877767531554176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778806.289519:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531554176:0@lo:400: 00000100:00100000:3.0:1790778806.290529:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531554304 00000100:00100000:3.0:1790778806.290547:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531554304 00000100:00100000:3.0:1790778806.290756:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778806.290765:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531554304:12345-0@lo:13: 00002000:00000024:3.0:1790778806.290805:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778806.290907:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531554304:12345-0@lo:13: Request processed in 142us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778806.290915:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790778806.291030:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d75c00 x1877767531554304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778806.291056:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531554304:0@lo:13: 00000100:00100000:3.0:1790778806.295660:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531553920:12345-0@lo:400: Request processed in 7792us (8962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778806.295688:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790778806.297912:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e38380 x1877767531553920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778806.297957:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531553920:0@lo:400: 00000001:00100000:1.0:1790778806.300737:0:5927:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000001:02000400:3.0:1790778806.594847:0:8671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1790778806.605814:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778806.605865:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778806.605910:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778806.605961:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778806.605998:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560384 00000100:00100000:2.0:1790778806.606020:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560384 00000100:00100000:2.0:1790778806.606096:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:2.0:1790778806.606111:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510560384:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1790778806.606235:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510560384:12345-192.168.202.2@tcp:400: Request processed in 127us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778806.606246:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:0.0:1790778806.606787:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560768 00000100:00100000:0.0:1790778806.606813:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560768 00000100:00100000:0.0:1790778806.606883:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560640 00000100:00100000:0.0:1790778806.606887:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560640 00000100:00100000:0.0:1790778806.606908:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790778806.606917:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510560768:12345-192.168.202.2@tcp:400: 00000100:00100000:0.0:1790778806.606990:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510560768:12345-192.168.202.2@tcp:400: Request processed in 74us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778806.606998:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790778806.607016:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790778806.607022:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510560640:12345-192.168.202.2@tcp:400: 00000100:00100000:0.0:1790778806.607048:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510560640:12345-192.168.202.2@tcp:400: Request processed in 27us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778806.607054:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:0.0:1790778806.607073:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790778806.607079:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778806.607606:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560512 00000100:00100000:1.0:1790778806.607614:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560512 00000100:00100000:1.0:1790778806.607677:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:1.0:1790778806.607686:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510560512:12345-192.168.202.2@tcp:400: 00000100:00100000:1.0:1790778806.607736:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510560512:12345-192.168.202.2@tcp:400: Request processed in 51us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778806.607744:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00080000:0.0:1790778806.608819:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778807.053492:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790778807.316828:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00010000:00010000:1.0:1790778808.076699:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778809.101074:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778810.125867:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790778810.595172:0:8818:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc98de36f0 20000000:00000080:0.0:1790778810.595198:0:8818:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef235d6a400 uarg=0000000000000000 20000000:01000000:0.0:1790778810.595254:0:8818:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790778810.595257:0:8818:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790778810.595261:0:8818:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790778810.595266:0:8818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790778810.595273:0:8818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790778810.595414:0:8818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790778810.595418:0:8818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790778810.596398:0:8819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1790778810.596888:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1790778810.596939:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1790778810.596957:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1790778810.596967:0:8818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790778810.596979:0:8818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790778810.597870:0:8820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1790778810.598135:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1790778810.598162:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1790778810.598178:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1790778810.598189:0:8818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790778810.598191:0:8818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790778810.598771:0:8821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1790778810.599035:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1790778810.599061:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1790778810.599104:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1790778810.599115:0:8818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790778810.599118:0:8818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790778810.599860:0:8822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790778810.600086:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790778810.600108:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1790778810.600122:0:8818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1790778810.600135:0:8818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790778810.600165:0:8818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600192:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074770 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600200:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607479a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600208:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747c4 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600215:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747d2 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600222:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747e0 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600244:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560747fc expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600252:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074826 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600265:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600273:0:8818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600283:0:8818:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600414:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600437:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 9 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.600538:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554432:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778810.600747:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600757:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 9 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.600766:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554560:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778810.600820:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074826 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600829:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074826 expref: 18 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.600838:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554688:0@lo:104: 00000100:00100000:0.0:1790778810.600893:0:8818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778810.600944:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560747fc expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.600951:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560747fc expref: 18 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.600959:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554816:0@lo:104: 00000100:00100000:0.0:1790778810.600981:0:8818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778810.601011:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560747e0 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.601019:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560747e0 expref: 18 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.601027:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554944:0@lo:104: 00010000:00010000:0.0:1790778810.601049:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560747d2 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.601056:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560747d2 expref: 18 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.601063:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555072:0@lo:104: 00010000:00010000:0.0:1790778810.601096:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560747c4 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.601104:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560747c4 expref: 18 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.601111:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555200:0@lo:104: 00010000:00010000:0.0:1790778810.601153:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607479a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.601160:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607479a expref: 18 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.601167:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555328:0@lo:104: 00010000:00010000:0.0:1790778810.601190:0:8818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074770 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778810.601197:0:8818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074770 expref: 18 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.601204:0:8818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555456:0@lo:104: 00000100:00100000:0.0:1790778810.601222:0:8818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21111fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778810.602578:0:5932:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790778810.602627:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.602655:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.602668:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.602703:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.602717:0:5932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.602729:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531554688 00000100:00100000:1.0:1790778810.602740:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531554688 00000100:00100000:1.0:1790778810.602795:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531554816 00000100:00100000:1.0:1790778810.602799:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531554816 00000100:00100000:1.0:1790778810.602810:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531554944 00000100:00100000:1.0:1790778810.602813:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531554944 00000100:00100000:1.0:1790778810.602822:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555072 00000100:00100000:1.0:1790778810.602824:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555072 00000100:00100000:1.0:1790778810.602831:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555200 00000100:00100000:1.0:1790778810.602841:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555200 00000100:00100000:1.0:1790778810.602855:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555328 00000100:00100000:1.0:1790778810.602858:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555328 00000100:00100000:1.0:1790778810.602867:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555456 00000100:00100000:1.0:1790778810.602869:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555456 00000100:00100000:1.0:1790778810.602884:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778810.602896:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+9:8818:x1877767531554688:12345-0@lo:104: 00010000:00010000:1.0:1790778810.602929:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.603048:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790778810.603056:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+9:8818:x1877767531554688:12345-0@lo:104: Request processed in 162us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.603065:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778810.603087:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778810.603094:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+8:8818:x1877767531554816:12345-0@lo:104: 00010000:00010000:1.0:1790778810.603102:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.603139:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790778810.603145:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+8:8818:x1877767531554816:12345-0@lo:104: Request processed in 52us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.603150:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778810.603193:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790778810.603200:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+7:8818:x1877767531554944:12345-0@lo:104: 00010000:00010000:1.0:1790778810.603207:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.603238:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790778810.603250:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+7:8818:x1877767531554944:12345-0@lo:104: Request processed in 51us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.603257:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790778810.603269:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790778810.603274:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+6:8818:x1877767531555072:12345-0@lo:104: 00010000:00010000:1.0:1790778810.603283:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604477:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790778810.604494:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+6:8818:x1877767531555072:12345-0@lo:104: Request processed in 1215us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.604507:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790778810.604548:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790778810.604562:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+5:8818:x1877767531555200:12345-0@lo:104: 00010000:00010000:1.0:1790778810.604576:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604653:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790778810.604658:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+5:8818:x1877767531555200:12345-0@lo:104: Request processed in 104us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.604664:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790778810.604677:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790778810.604684:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:8818:x1877767531555328:12345-0@lo:104: 00010000:00010000:1.0:1790778810.604692:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604720:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1790778810.604740:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:8818:x1877767531555328:12345-0@lo:104: Request processed in 57us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.604747:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790778810.604760:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778810.604766:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:8818:x1877767531555456:12345-0@lo:104: 00010000:00010000:1.0:1790778810.604775:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604803:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1790778810.604808:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:8818:x1877767531555456:12345-0@lo:104: Request processed in 43us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.604814:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790778810.604844:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1790778810.604852:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604859:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.604865:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604875:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.604883:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.604889:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.604955:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.604972:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605003:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605011:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656074826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607482d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605032:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1790778810.605036:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605041:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.605045:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605051:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.605058:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.605064:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.605077:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605084:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605103:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605111:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aa400/0xdc876326560747fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074803 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605135:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790778810.605138:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605144:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.605147:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605153:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.605159:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.605164:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.605178:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605184:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605189:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605196:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560747e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747e7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605205:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790778810.605209:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605223:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165aa00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.605226:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605233:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.605239:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.605244:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.605258:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605264:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605270:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605276:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165aa00/0xdc876326560747d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747d9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605286:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790778810.605289:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605295:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1c00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.605298:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605320:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.605327:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.605332:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.605346:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605352:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605356:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605362:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1c00/0xdc876326560747c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747cb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605373:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790778810.605376:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605381:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.605384:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605391:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.605398:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.605408:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.605422:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605427:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605431:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605437:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aae00/0xdc8763265607479a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560747a1 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605479:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778810.605482:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605488:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b200 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778810.605491:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605498:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778810.605505:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778810.605510:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790778810.605521:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605525:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778810.605534:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605540:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165b200/0xdc87632656074770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074777 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.605553:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778810.605554:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778810.605556:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778810.605587:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531555584:0@lo:103: 00000100:00100000:1.0:1790778810.605644:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605695:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531556096:0@lo:103: 00000100:00100000:1.0:1790778810.605712:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605733:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778810.605737:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531555968:0@lo:103: 00000100:00100000:1.0:1790778810.605755:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605782:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531555840:0@lo:103: 00000100:00100000:1.0:1790778810.605802:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605812:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531556352:0@lo:103: 00000100:00100000:1.0:1790778810.605829:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605839:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790778810.605845:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531555712:0@lo:103: 00000100:00100000:1.0:1790778810.605864:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605873:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531556224:0@lo:103: 00000100:00100000:1.0:1790778810.605893:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778810.605927:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555584 00000100:00100000:1.0:1790778810.605936:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555584 00010000:00010000:1.0:1790778810.605981:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074826 expref: 19 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606002:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556096 00000100:00100000:1.0:1790778810.606005:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556096 00010000:00010000:1.0:1790778810.606017:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747c4 expref: 20 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606028:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555968 00000100:00100000:1.0:1790778810.606031:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555968 00010000:00010000:1.0:1790778810.606041:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747d2 expref: 21 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606052:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555840 00000100:00100000:1.0:1790778810.606054:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555840 00010000:00010000:1.0:1790778810.606064:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747e0 expref: 22 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606073:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556352 00000100:00100000:1.0:1790778810.606075:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556352 00010000:00010000:1.0:1790778810.606084:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074770 expref: 23 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606093:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531555712 00000100:00100000:1.0:1790778810.606095:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531555712 00010000:00010000:1.0:1790778810.606104:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747fc expref: 24 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606114:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556224 00000100:00100000:1.0:1790778810.606116:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556224 00010000:00010000:1.0:1790778810.606124:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607479a expref: 25 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.606136:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778810.606150:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+25:3442:x1877767531555584:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606164:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606171:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074826 expref: 25 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606181:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074826 expref: 25 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606201:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606235:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+25:3442:x1877767531555584:12345-0@lo:103: Request processed in 86us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606241:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778810.606257:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778810.606263:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+24:3442:x1877767531556096:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606269:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606273:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747c4 expref: 24 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606282:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560747c4 expref: 24 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606292:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606310:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+24:3442:x1877767531556096:12345-0@lo:103: Request processed in 48us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606315:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778810.606326:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790778810.606332:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+23:3442:x1877767531555968:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606339:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606349:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747d2 expref: 23 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606357:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560747d2 expref: 23 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606365:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606386:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+23:3442:x1877767531555968:12345-0@lo:103: Request processed in 55us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606391:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790778810.606403:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790778810.606407:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+22:3440:x1877767531555840:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606414:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606418:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747e0 expref: 22 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606425:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560747e0 expref: 22 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606432:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606481:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+22:3440:x1877767531555840:12345-0@lo:103: Request processed in 73us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606486:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790778810.606496:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790778810.606501:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+21:3440:x1877767531556352:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606508:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606512:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074770 expref: 21 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606529:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074770 expref: 21 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606539:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606561:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+21:3440:x1877767531556352:12345-0@lo:103: Request processed in 60us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606568:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790778810.606580:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790778810.606585:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+20:3440:x1877767531555712:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606612:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606618:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560747fc expref: 20 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606627:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560747fc expref: 20 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606635:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606658:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+20:3440:x1877767531555712:12345-0@lo:103: Request processed in 74us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606664:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790778810.606677:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778810.606682:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531556224:12345-0@lo:103: 00010000:00010000:1.0:1790778810.606689:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778810.606693:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607479a expref: 19 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606700:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607479a expref: 19 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.606717:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778810.606739:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531556224:12345-0@lo:103: Request processed in 57us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778810.606746:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778810.606818:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531555712:0@lo:103: 00000100:00100000:1.0:1790778810.606828:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531556224:0@lo:103: 00000100:00100000:1.0:1790778810.606836:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531555840:0@lo:103: 00000100:00100000:1.0:1790778810.606843:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531556352:0@lo:103: 00000100:00100000:1.0:1790778810.606874:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531555968:0@lo:103: 00000100:00100000:1.0:1790778810.606882:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531555584:0@lo:103: 00000100:00100000:1.0:1790778810.606889:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531556096:0@lo:103: 00010000:00010000:3.0:1790778810.608662:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778810.608696:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778810.608850:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014abe00/0xdc8763265607482d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074826 expref: 18 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.608875:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554688:0@lo:104: 00010000:00010000:0.0:1790778810.608890:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165be00/0xdc87632656074803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560747fc expref: 17 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.608901:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554816:0@lo:104: 00010000:00010000:0.0:1790778810.608932:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201498800/0xdc876326560747e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560747e0 expref: 16 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.608964:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554944:0@lo:104: 00010000:00010000:0.0:1790778810.608975:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014aa200/0xdc876326560747d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560747d2 expref: 15 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.608985:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555072:0@lo:104: 00010000:00010000:0.0:1790778810.608997:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014aba00/0xdc876326560747cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560747c4 expref: 14 pid: 5944 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.609005:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555200:0@lo:104: 00010000:00010000:0.0:1790778810.609015:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a1200/0xdc876326560747a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607479a expref: 13 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.609024:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555328:0@lo:104: 00010000:00010000:0.0:1790778810.609035:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165ae00/0xdc87632656074777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074770 expref: 12 pid: 5943 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778810.609045:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531555456:0@lo:104: 00000100:00100000:1.0:1790778810.616574:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554432:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778810.616595:0:8818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8818:1877767531554560:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778810.616656:0:8818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778810.617884:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778810.617984:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778810.618303:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510560896 00000100:00100000:2.0:1790778810.618322:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510560896 00010000:00010000:2.0:1790778810.618394:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 10 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778810.618470:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561024 00000100:00100000:2.0:1790778810.618474:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561024 00010000:00010000:2.0:1790778810.618487:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 11 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778810.618504:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1790778810.618514:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:2345:x1877767510560896:12345-192.168.202.2@tcp:103: 00010000:00010000:2.0:1790778810.618538:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778810.618545:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 11 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.618558:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 11 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.618584:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201498c00/0xdc87632656074842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca91 expref: 11 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.618629:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778810.618728:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2345:x1877767510560896:12345-192.168.202.2@tcp:103: Request processed in 214us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778810.618737:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1790778810.618760:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1790778810.618766:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:2345:x1877767510561024:12345-192.168.202.2@tcp:103: 00010000:00010000:2.0:1790778810.618774:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778810.618778:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 9 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.618786:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 9 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619534:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499e00/0xdc8763265607483b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dca8a expref: 9 pid: 5942 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619568:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619579:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619601:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619609:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619616:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619623:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619643:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778810.619648:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619657:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619671:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778810.619682:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778810.619790:0:8818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.619810:0:8818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778810.619828:0:8818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a0e00/0xdc8763265607487a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778810.624046:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:2345:x1877767510561024:12345-192.168.202.2@tcp:103: Request processed in 5253us (6035us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778810.624072:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:1.0:1790778811.147767:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778811.403788:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778811.403831:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531556480:0@lo:13: 00000100:00100000:2.0:1790778811.403973:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778811.404095:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531556736:0@lo:400: 00000100:00100000:2.0:1790778811.404108:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531556608:0@lo:13: 00000100:00100000:1.0:1790778811.404208:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531556992:0@lo:400: 00000100:00100000:3.0:1790778811.404250:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556480 00000100:00100000:3.0:1790778811.404262:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556480 00000100:00100000:3.0:1790778811.405549:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790778811.405567:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531556480:12345-0@lo:13: 00002000:00000024:3.0:1790778811.405615:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778811.408493:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.408624:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531557120:0@lo:400: 00000100:00100000:2.0:1790778811.408732:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790778811.408815:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778811.410070:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557120 00000100:00100000:2.0:1790778811.410087:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557120 00000100:00100000:2.0:1790778811.410164:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790778811.410174:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531557120:12345-0@lo:400: 00000100:00100000:2.0:1790778811.410989:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531557120:12345-0@lo:400: Request processed in 813us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.411024:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1790778811.411075:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778811.411132:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531557120:0@lo:400: 00000100:00100000:2.0:1790778811.411208:0:6939:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1790778811.411221:0:6939:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1790778811.411254:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531556864:0@lo:400: 00000100:00100000:2.0:1790778811.411983:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.412191:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556608 00000100:00100000:2.0:1790778811.412202:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556608 00000100:00080000:2.0:1790778811.412260:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778811.412557:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778811.412620:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556736 00000100:00100000:0.0:1790778811.412625:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556736 00000100:00100000:0.0:1790778811.412666:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790778811.412678:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:3439:x1877767531556736:12345-0@lo:400: 00000100:00100000:0.0:1790778811.412834:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+12:3439:x1877767531556736:12345-0@lo:400: Request processed in 159us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.412860:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790778811.412965:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531556736:0@lo:400: 00000100:00100000:0.0:1790778811.412978:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531557248:0@lo:400: 00000100:00100000:0.0:1790778811.413013:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778811.413040:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557248 00000100:00100000:0.0:1790778811.413045:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557248 00000100:00100000:0.0:1790778811.413077:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790778811.413084:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531557248:12345-0@lo:400: 00000100:00100000:0.0:1790778811.413119:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531557248:12345-0@lo:400: Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.413125:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790778811.413157:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e38380 x1877767531557248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778811.413172:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531557248:0@lo:400: 00000100:00100000:0.0:1790778811.413225:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556864 00000100:00100000:0.0:1790778811.413229:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556864 00000100:00100000:0.0:1790778811.413255:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790778811.413262:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531556864:12345-0@lo:400: 00000100:00100000:0.0:1790778811.413304:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531556864:12345-0@lo:400: Request processed in 42us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.413311:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790778811.413458:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778811.413486:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531556992 00000100:00100000:1.0:1790778811.413490:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531556992 00000100:00100000:1.0:1790778811.413522:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790778811.413530:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531556992:12345-0@lo:400: 00000100:00100000:1.0:1790778811.413564:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531556992:12345-0@lo:400: Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.413571:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1790778811.413592:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778811.413610:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531556992:0@lo:400: 00000100:00100000:1.0:1790778811.413662:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531556864:0@lo:400: 00000100:00100000:2.0:1790778811.414463:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790778811.414477:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531556608:12345-0@lo:13: 00002000:00000024:2.0:1790778811.414509:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778811.414581:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531556608:12345-0@lo:13: Request processed in 109us (6099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.414588:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1790778811.414652:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e39180 x1877767531556608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778811.414675:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531556608:0@lo:13: 00000100:00100000:3.0:1790778811.421340:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531556480:12345-0@lo:13: Request processed in 15761us (17349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778811.421367:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1790778811.421561:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2330edf80 x1877767531556480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778811.421606:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531556480:0@lo:13: 00000100:00100000:1.0:1790778811.665266:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778811.665409:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561152 00000100:00100000:2.0:1790778811.665426:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561152 00000100:00100000:2.0:1790778811.665555:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:2.0:1790778811.665569:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:5437:x1877767510561152:12345-192.168.202.2@tcp:101: 00010000:00010000:2.0:1790778811.665601:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778811.665635:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4ce00/0xdc87632656074881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcaf3 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.665675:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4ce00/0xdc87632656074881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcaf3 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.665712:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4ce00/0xdc87632656074881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcaf3 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.665725:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4ce00, rc 0) 00000100:00100000:2.0:1790778811.665818:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510561152:12345-192.168.202.2@tcp:101: Request processed in 248us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.665827:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:0.0:1790778811.669819:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778811.669968:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561280 00000100:00100000:2.0:1790778811.669985:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561280 00000100:00100000:2.0:1790778811.670082:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:2.0:1790778811.670097:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510561280:12345-192.168.202.2@tcp:501: 00000100:00100000:2.0:1790778811.670362:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510561280:12345-192.168.202.2@tcp:501: Request processed in 268us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.670371:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:1.0:1790778811.682154:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778811.682341:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561408 00000100:00100000:0.0:1790778811.682357:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561408 00000100:00100000:0.0:1790778811.682487:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1790778811.682503:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510561408:12345-192.168.202.2@tcp:503: 00000100:00100000:0.0:1790778811.682805:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510561408:12345-192.168.202.2@tcp:503: Request processed in 306us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.682815:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:3.0:1790778811.696052:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778811.696205:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561536 00000100:00100000:1.0:1790778811.696220:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561536 00000100:00100000:1.0:1790778811.696349:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:1.0:1790778811.696363:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5905:x1877767510561536:12345-192.168.202.2@tcp:502: 00000100:00100000:2.0:1790778811.697157:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5905:x1877767510561536:12345-192.168.202.2@tcp:502: Request processed in 790us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.697170:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:2.0:1790778811.702508:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778811.702712:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561664 00000100:00100000:1.0:1790778811.702725:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561664 00000100:00100000:1.0:1790778811.702800:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:1.0:1790778811.702812:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5905:x1877767510561664:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790778811.703035:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5905:x1877767510561664:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 225us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.703045:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:1.0:1790778811.706172:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778811.706490:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561792 00000100:00100000:2.0:1790778811.706503:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561792 00000100:00100000:2.0:1790778811.706576:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:2.0:1790778811.706588:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510561792:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778811.706611:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778811.706648:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4d800/0xdc87632656074888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcafa expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.706710:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4d800/0xdc87632656074888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcafa expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.706724:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4d800/0xdc87632656074888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcafa expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.706736:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4d800, rc 0) 00000100:00100000:2.0:1790778811.706815:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510561792:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 228us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.706823:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:3.0:1790778811.715815:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778811.715963:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510561920 00000100:00100000:0.0:1790778811.715978:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510561920 00000100:00100000:0.0:1790778811.716051:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:0.0:1790778811.716064:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510561920:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.716240:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510561920:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 178us (439us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778811.716249:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:0.0:1790778811.726426:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778811.726521:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778811.726639:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562048 00000100:00100000:1.0:1790778811.726657:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562048 00000100:00100000:1.0:1790778811.726757:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:1.0:1790778811.726770:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2343:x1877767510562048:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778811.726911:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2343:x1877767510562048:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 144us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.726920:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1790778811.727065:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562176 00000100:00100000:2.0:1790778811.727071:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562176 00000100:00100000:2.0:1790778811.727121:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790778811.727129:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2343:x1877767510562176:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778811.727163:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2343:x1877767510562176:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.727170:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:3.0:1790778811.727268:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778811.727275:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778811.731839:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778811.731997:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562304 00000100:00100000:0.0:1790778811.732015:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562304 00000100:00100000:0.0:1790778811.732109:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1790778811.732120:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510562304:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778811.732234:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510562304:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 115us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.732243:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00080000:3.0:1790778811.734029:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1790778811.853052:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790778811.853068:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef235b0c800 from 39 10000000:01000000:1.0:1790778811.853078:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790778811.853154:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.853169:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.853207:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778811.853242:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531557376:0@lo:101: 00000100:00100000:1.0:1790778811.853494:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778811.853672:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.854183:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557376 00000100:00100000:2.0:1790778811.854195:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557376 00000100:00100000:2.0:1790778811.854264:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790778811.854275:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+12:5946:x1877767531557376:12345-0@lo:101: 00010000:00010000:2.0:1790778811.854304:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778811.854326:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4d600/0xdc87632656074896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607488f expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.854363:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4d600/0xdc87632656074896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607488f expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.854391:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4d600/0xdc87632656074896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607488f expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.854403:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4d600, rc 0) 00000100:00100000:2.0:1790778811.854529:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531557376:12345-0@lo:101: Request processed in 255us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.854537:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790778811.855593:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531557376:0@lo:101: 00010000:00010000:1.0:1790778811.855631:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.855646:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778811.855765:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531557504:0@lo:501: 00000100:00100000:1.0:1790778811.855822:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778811.855884:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.856148:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557504 00000100:00100000:2.0:1790778811.856156:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557504 00000100:00100000:2.0:1790778811.856203:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790778811.856212:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531557504:12345-0@lo:501: 00000100:00100000:2.0:1790778811.856383:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531557504:12345-0@lo:501: Request processed in 171us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.856391:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790778811.856540:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531557504:0@lo:501: 00000100:00100000:3.0:1790778811.856579:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531557632:0@lo:503: 00000100:00100000:3.0:1790778811.856632:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.856667:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.856831:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557632 00000100:00100000:0.0:1790778811.856837:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557632 00000100:00100000:0.0:1790778811.856869:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790778811.856876:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531557632:12345-0@lo:503: 00000100:00100000:0.0:1790778811.856994:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531557632:12345-0@lo:503: Request processed in 118us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.857012:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790778811.857147:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531557632:0@lo:503: 00000100:00100000:3.0:1790778811.857942:0:8835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8835:1877767531557760:0@lo:502: 00000100:00100000:3.0:1790778811.858003:0:8835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.858043:0:8835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.858153:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557760 00000100:00100000:0.0:1790778811.858160:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557760 00000100:00100000:0.0:1790778811.858201:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790778811.858210:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8835:x1877767531557760:12345-0@lo:502: 00000100:00100000:0.0:1790778811.858489:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+13:8835:x1877767531557760:12345-0@lo:502: Request processed in 279us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.858497:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790778811.860699:0:8835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8835:1877767531557760:0@lo:502: 00000100:00100000:3.0:1790778811.860810:0:8835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8835:1877767531557888:0@lo:502: 00000100:00100000:3.0:1790778811.861256:0:8835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.861321:0:8835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.861426:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531557888 00000100:00100000:1.0:1790778811.861436:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531557888 00000100:00100000:1.0:1790778811.861533:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790778811.861544:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:8835:x1877767531557888:12345-0@lo:502: 00000100:00100000:1.0:1790778811.862165:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+13:8835:x1877767531557888:12345-0@lo:502: Request processed in 620us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.862175:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790778811.873583:0:8835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8835:1877767531557888:0@lo:502: 00000040:00080000:3.0:1790778811.873643:0:8835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790778811.873938:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790778811.873972:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790778811.873988:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.874012:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778811.874024:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1790778811.874027:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1790778811.874031:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790778811.874078:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.874087:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.874098:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778811.874123:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236424e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558016:0@lo:101: 00000100:00100000:1.0:1790778811.874208:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778811.874266:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.874277:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558016 00000100:00100000:2.0:1790778811.874343:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558016 00000100:00100000:2.0:1790778811.874411:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790778811.874424:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+13:5946:x1877767531558016:12345-0@lo:101: 00010000:00010000:2.0:1790778811.874468:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778811.874486:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4d200/0xdc876326560748a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607489d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.874528:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4d200/0xdc876326560748a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607489d expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.874540:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4d200/0xdc876326560748a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607489d expref: 14 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.874564:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4d200, rc 0) 00000100:00100000:2.0:1790778811.874621:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531558016:12345-0@lo:101: Request processed in 200us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.874629:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790778811.876169:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236424e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558016:0@lo:101: 00010000:00010000:3.0:1790778811.876208:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.876224:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778811.876332:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558144:0@lo:501: 00000100:00100000:3.0:1790778811.876399:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778811.876481:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558144 00000100:00100000:3.0:1790778811.876484:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.876491:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558144 00000100:00100000:1.0:1790778811.876679:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790778811.876691:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531558144:12345-0@lo:501: 00000100:00100000:1.0:1790778811.877019:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531558144:12345-0@lo:501: Request processed in 329us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.877036:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790778811.877244:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558144:0@lo:501: 00000100:00100000:3.0:1790778811.877298:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558272:0@lo:503: 00000100:00100000:3.0:1790778811.877346:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.877417:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.877709:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558272 00000100:00100000:1.0:1790778811.877714:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558272 00000100:00100000:1.0:1790778811.877813:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790778811.877827:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531558272:12345-0@lo:503: 00000100:00100000:1.0:1790778811.877983:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531558272:12345-0@lo:503: Request processed in 156us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.877991:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790778811.878279:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558272:0@lo:503: 00000100:00100000:3.0:1790778811.882299:0:8837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8837:1877767531558400:0@lo:502: 00000100:00100000:3.0:1790778811.882492:0:8837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.882552:0:8837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.883088:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558400 00000100:00100000:1.0:1790778811.883104:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558400 00000100:00100000:1.0:1790778811.883196:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790778811.883210:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8837:x1877767531558400:12345-0@lo:502: 00000100:00100000:1.0:1790778811.883429:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+14:8837:x1877767531558400:12345-0@lo:502: Request processed in 222us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.883465:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790778811.883628:0:8837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8837:1877767531558400:0@lo:502: 00000020:01000000:3.0:1790778811.883670:0:8837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778811.883841:0:8837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778811.883845:0:8837:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790778811.883881:0:8837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790778811.883998:0:8837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8837:1877767531558528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.884056:0:8837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.884107:0:8837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.887201:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558528 00000100:00100000:1.0:1790778811.887224:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558528 00000100:00100000:1.0:1790778811.887321:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790778811.887336:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8837:x1877767531558528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778811.887647:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:8837:x1877767531558528:12345-0@lo:502:llog_process_th.0 Request processed in 315us (3590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.887656:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790778811.889055:0:8837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8837:1877767531558528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790778811.889117:0:8837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778811.889129:0:8837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778811.889131:0:8837:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790778811.889140:0:8837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1790778811.889799:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1790778811.889827:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790778811.889842:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.889856:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778811.889869:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790778811.889872:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef2332da000 from 39 10000000:01000000:2.0:1790778811.889875:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790778811.890005:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.890016:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.890029:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.890062:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.890151:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.890216:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.890364:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558656 00000100:00100000:1.0:1790778811.890373:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558656 00000100:00100000:1.0:1790778811.890417:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790778811.890430:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:5946:x1877767531558656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778811.890463:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778811.890483:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236387a00/0xdc876326560748b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560748ab expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.890520:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236387a00/0xdc876326560748b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560748ab expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.890551:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236387a00/0xdc876326560748b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748ab expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.890562:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387a00, rc 0) 00000100:00100000:1.0:1790778811.890608:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531558656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.890615:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790778811.894241:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778811.894312:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.894326:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.894484:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.894581:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.894644:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.894918:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558784 00000100:00100000:1.0:1790778811.894995:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558784 00000100:00100000:1.0:1790778811.895076:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790778811.895088:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531558784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778811.895292:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531558784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.895300:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790778811.895464:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.895507:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.895557:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.895586:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.897064:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531558912 00000100:00100000:1.0:1790778811.897088:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531558912 00000100:00100000:1.0:1790778811.898079:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790778811.898098:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531558912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778811.898321:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531558912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.898330:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790778811.898414:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531558912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.898741:0:8838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8838:1877767531559040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.898795:0:8838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.913962:0:8838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3300 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.918143:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559040 00000100:00100000:2.0:1790778811.918167:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559040 00000100:00100000:2.0:1790778811.918266:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790778811.918277:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:8838:x1877767531559040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.918548:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:8838:x1877767531559040:12345-0@lo:502:llog_process_th.0 Request processed in 272us (19752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.918556:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790778811.921676:0:8838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8838:1877767531559040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.921816:0:8838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8838:1877767531559168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.922361:0:8838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.922470:0:8838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.922504:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559168 00000100:00100000:2.0:1790778811.922512:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559168 00000100:00100000:2.0:1790778811.922574:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790778811.922585:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:8838:x1877767531559168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.922750:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:8838:x1877767531559168:12345-0@lo:502:llog_process_th.0 Request processed in 166us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.922769:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790778811.922834:0:8838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8838:1877767531559168:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790778811.922860:0:8838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790778811.929515:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790778811.929568:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778811.929586:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.929602:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778811.929614:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790778811.929618:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1790778811.929622:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790778811.929672:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.929681:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.929695:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.929730:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.929836:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.929915:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.930141:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559296 00000100:00100000:1.0:1790778811.930154:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559296 00000100:00100000:1.0:1790778811.930217:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790778811.930228:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+15:5946:x1877767531559296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778811.930248:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778811.930274:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236386e00/0xdc876326560748c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560748b9 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.930306:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236386e00/0xdc876326560748c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560748b9 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.930319:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236386e00/0xdc876326560748c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748b9 expref: 16 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778811.930329:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386e00, rc 0) 00000100:00100000:1.0:1790778811.930379:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531559296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.930387:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790778811.930504:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778811.930521:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.930538:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.930606:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.930633:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.930660:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778811.930714:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559424 00000100:00100000:1.0:1790778811.930718:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559424 00000100:00100000:1.0:1790778811.930746:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790778811.930754:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531559424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778811.931051:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531559424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778811.931060:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790778811.935199:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.935293:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.935403:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.935493:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97180 going to sleep for 11 seconds 00000100:00100000:3.0:1790778811.935952:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559552 00000100:00100000:3.0:1790778811.935965:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559552 00000100:00100000:3.0:1790778811.936039:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790778811.936050:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531559552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.936255:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531559552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778811.936266:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790778811.936616:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.937163:0:8840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8840:1877767531559680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.937223:0:8840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.937265:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559680 00000100:00100000:3.0:1790778811.937272:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559680 00000100:00100000:2.0:1790778811.937272:0:8840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97600 going to sleep for 11 seconds 00000100:00100000:3.0:1790778811.937324:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790778811.937342:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:8840:x1877767531559680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.937494:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:8840:x1877767531559680:12345-0@lo:502:llog_process_th.0 Request processed in 154us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778811.937503:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790778811.937665:0:8840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8840:1877767531559680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778811.937695:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778811.937709:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778811.937711:0:8840:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790778811.937717:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790778811.937745:0:8840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8840:1877767531559808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778811.937781:0:8840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.937890:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559808 00000100:00100000:3.0:1790778811.937906:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559808 00000100:00100000:3.0:1790778811.937934:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790778811.937941:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:8840:x1877767531559808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.938005:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:8840:x1877767531559808:12345-0@lo:502:llog_process_th.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778811.938011:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790778811.938070:0:8840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2209cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.938084:0:8840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8840:1877767531559808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778811.938103:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778811.938107:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778811.938109:0:8840:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790778811.938113:0:8840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1790778811.938292:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790778811.939947:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790778811.939975:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.939992:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778811.940005:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790778811.940009:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef211145000 from 39 10000000:01000000:3.0:1790778811.940013:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790778811.940066:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.940076:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.940090:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778811.940125:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.940194:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.940232:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.940354:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531559936 00000100:00100000:0.0:1790778811.940363:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531559936 00000100:00100000:0.0:1790778811.940433:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790778811.940468:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531559936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778811.940493:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778811.940516:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0000/0xdc876326560748ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560748c7 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.940552:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0000/0xdc876326560748ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560748c7 expref: 17 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.940565:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a0000/0xdc876326560748ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748c7 expref: 17 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.940577:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0000, rc 0) 00000100:00100000:0.0:1790778811.940633:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531559936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.940642:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790778811.940703:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531559936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778811.940718:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.940727:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778811.940805:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.940832:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778811.940868:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2209cacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778811.941022:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560064 00000100:00100000:3.0:1790778811.941027:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560064 00000100:00100000:3.0:1790778811.941065:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790778811.941073:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531560064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.941230:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531560064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778811.941238:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790778811.941676:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.941723:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.941787:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778811.942030:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2209cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.942092:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560192 00000100:00100000:2.0:1790778811.942099:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560192 00000100:00100000:2.0:1790778811.942145:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790778811.942154:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531560192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.942290:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531560192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.942298:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790778811.942469:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778811.943154:0:8841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8841:1877767531560320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.943221:0:8841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.943281:0:8841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.943503:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560320 00000100:00100000:0.0:1790778811.943513:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560320 00000100:00100000:0.0:1790778811.943555:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790778811.943565:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:8841:x1877767531560320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778811.943732:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:8841:x1877767531560320:12345-0@lo:502:llog_process_th.0 Request processed in 167us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.943741:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790778811.943930:0:8841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8841:1877767531560320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.943993:0:8841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8841:1877767531560448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.944030:0:8841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.944066:0:8841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.948237:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560448 00000100:00100000:0.0:1790778811.948261:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560448 00000100:00100000:0.0:1790778811.948346:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790778811.948359:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:8841:x1877767531560448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778811.948637:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:8841:x1877767531560448:12345-0@lo:502:llog_process_th.0 Request processed in 280us (4605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.948647:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790778811.948988:0:8841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8841:1877767531560448:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790778811.949043:0:8841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790778811.949272:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790778811.949300:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790778811.949314:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.949340:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778811.949354:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790778811.949358:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790778811.949362:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790778811.949408:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.949417:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.949429:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.949497:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.949568:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.949626:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778811.949774:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560576 00000100:00100000:3.0:1790778811.949781:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560576 00000100:00100000:3.0:1790778811.949825:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790778811.949843:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531560576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778811.949861:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778811.949879:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201499c00/0xdc876326560748dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560748d5 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.949919:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201499c00/0xdc876326560748dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560748d5 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.949933:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201499c00/0xdc876326560748dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748d5 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.949944:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201499c00, rc 0) 00000100:00100000:3.0:1790778811.949999:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531560576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778811.950007:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790778811.950117:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778811.950133:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.950144:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.950211:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.950239:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.950281:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.950324:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560704 00000100:00100000:0.0:1790778811.950330:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560704 00000100:00100000:0.0:1790778811.950365:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790778811.950374:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531560704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.950572:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531560704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.950581:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790778811.950707:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.950756:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.950795:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.950825:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.950877:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560832 00000100:00100000:0.0:1790778811.950882:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560832 00000100:00100000:0.0:1790778811.950918:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790778811.950925:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531560832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.951030:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531560832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.951042:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790778811.951119:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531560832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.951810:0:8842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8842:1877767531560960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.951867:0:8842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.951921:0:8842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.951975:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531560960 00000100:00100000:0.0:1790778811.951982:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531560960 00000100:00100000:0.0:1790778811.952022:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790778811.952030:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:8842:x1877767531560960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778811.952159:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:8842:x1877767531560960:12345-0@lo:502:llog_process_th.0 Request processed in 129us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.952165:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790778811.952253:0:8842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8842:1877767531560960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790778811.952284:0:8842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778811.952298:0:8842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778811.952301:0:8842:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790778811.952312:0:8842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790778811.952336:0:8842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8842:1877767531561088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778811.952372:0:8842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778811.952404:0:8842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778811.952490:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561088 00000100:00100000:2.0:1790778811.952496:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561088 00000100:00100000:2.0:1790778811.952519:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790778811.952526:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:8842:x1877767531561088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778811.952616:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:8842:x1877767531561088:12345-0@lo:502:llog_process_th.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778811.952624:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790778811.952734:0:8842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8842:1877767531561088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790778811.952753:0:8842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778811.952757:0:8842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778811.952759:0:8842:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790778811.952764:0:8842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790778811.953006:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1790778811.953031:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790778811.953042:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.953054:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778811.953067:0:5946:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790778811.953070:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef2201619c0 from 1 10000000:01000000:2.0:1790778811.953073:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790778811.953110:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.953120:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.953130:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.953146:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531561216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.953177:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.953212:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.953261:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561216 00000100:00100000:0.0:1790778811.953266:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561216 00000100:00100000:0.0:1790778811.953298:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790778811.953305:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531561216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778811.953315:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778811.953327:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0c00/0xdc876326560748ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560748e3 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.953349:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0c00/0xdc876326560748ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560748e3 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.953359:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a0c00/0xdc876326560748ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748e3 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778811.953368:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0c00, rc 0) 00000100:00100000:0.0:1790778811.953408:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531561216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778811.953414:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790778811.953546:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531561216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778811.953559:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778811.953568:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778811.953619:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531561344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778811.953646:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778811.953664:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778811.953713:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561344 00000100:00100000:0.0:1790778811.953726:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561344 00000100:00100000:0.0:1790778811.953755:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790778811.953762:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531561344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778811.953921:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531561344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778811.953929:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790778811.958742:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531561344:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1790778811.960693:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790778811.960717:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778811.960735:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.172616:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790778812.798086:0:8878:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc514193a0 20000000:00000080:2.0:1790778812.798107:0:8878:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef236439c00 uarg=0000000000000000 20000000:01000000:2.0:1790778812.798152:0:8878:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790778812.798157:0:8878:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790778812.798162:0:8878:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790778812.798861:0:8879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790778812.799031:0:8878:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790778812.803133:0:8878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790778812.803192:0:8878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790778812.803210:0:8878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790778812.803227:0:8878:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790778812.803253:0:8878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803336:0:8878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607465f expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803348:0:8878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560746c1 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803356:0:8878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607478c expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803367:0:8878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803376:0:8878:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803431:0:8878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 9 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803540:0:8878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 9 pid: 5944 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778812.803558:0:8878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561472:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778812.803747:0:8878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607478c expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803756:0:8878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607478c expref: 18 pid: 5943 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778812.803774:0:8878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561600:0@lo:104: 00000100:00100000:2.0:1790778812.803818:0:8878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778812.803856:0:8878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560746c1 expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803864:0:8878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560746c1 expref: 18 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778812.803873:0:8878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561728:0@lo:104: 00000100:00100000:2.0:1790778812.803906:0:8878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778812.803940:0:8878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607465f expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.803948:0:8878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607465f expref: 18 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778812.803957:0:8878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561856:0@lo:104: 00000100:00100000:2.0:1790778812.803974:0:8878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bad780 going to sleep for 11 seconds 00000100:00100000:3.0:1790778812.804158:0:5931:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790778812.804176:0:5931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778812.804185:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561600 00000100:00100000:3.0:1790778812.804193:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561600 00000100:00100000:3.0:1790778812.804232:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561728 00000100:00100000:3.0:1790778812.804234:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561728 00000100:00100000:3.0:1790778812.804242:0:5931:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561856 00000100:00100000:3.0:1790778812.804244:0:5931:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561856 00000100:00100000:3.0:1790778812.804256:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790778812.804264:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+5:8878:x1877767531561600:12345-0@lo:104: 00010000:00010000:3.0:1790778812.804284:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.804343:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790778812.804349:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+5:8878:x1877767531561600:12345-0@lo:104: Request processed in 87us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778812.804357:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790778812.804376:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778812.804382:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2363ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+4:8878:x1877767531561728:12345-0@lo:104: 00010000:00010000:3.0:1790778812.804389:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.804427:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790778812.804432:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2363ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+4:8878:x1877767531561728:12345-0@lo:104: Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778812.804439:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778812.804498:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790778812.804503:0:5931:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:8878:x1877767531561856:12345-0@lo:104: 00010000:00010000:3.0:1790778812.804511:0:5931:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.804538:0:5931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790778812.804542:0:5931:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:763f742b-0483-425a-8826-84839ee976ad+3:8878:x1877767531561856:12345-0@lo:104: Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778812.804548:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1790778812.804562:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790778812.804568:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.804575:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778812.804579:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.804588:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778812.804596:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778812.804892:0:8878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561600:0@lo:104: 00000100:00100000:2.0:1790778812.804903:0:8878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561728:0@lo:104: 00000100:00100000:2.0:1790778812.804910:0:8878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561856:0@lo:104: 10000000:01000000:3.0:1790778812.805022:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790778812.805074:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805082:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778812.805103:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805111:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0400/0xdc8763265607478c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074793 expref: -99 pid: 8006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805123:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790778812.805127:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805132:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aac00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778812.805135:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805143:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778812.805149:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778812.805154:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790778812.805165:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805171:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778812.805184:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805201:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014aac00/0xdc876326560746c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560746c8 expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805211:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778812.805214:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805220:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030200 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778812.805224:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805230:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778812.805236:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778812.805241:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790778812.805255:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805260:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778812.805267:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805282:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef200030200/0xdc8763265607465f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074666 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.805296:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778812.805304:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778812.805306:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778812.805395:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778812.805401:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778812.805415:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531561984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778812.805486:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778812.805553:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531562112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778812.805578:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778812.805620:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790778812.805627:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531562240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778812.805648:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778812.805680:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531561984 00000100:00100000:1.0:1790778812.805687:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531561984 00010000:00010000:1.0:1790778812.805714:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607478c expref: 19 pid: 5943 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778812.805730:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562112 00000100:00100000:1.0:1790778812.805733:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562112 00010000:00010000:1.0:1790778812.805743:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746c1 expref: 20 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778812.805752:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562240 00000100:00100000:1.0:1790778812.805754:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562240 00010000:00010000:1.0:1790778812.805764:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607465f expref: 21 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778812.805776:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778812.805784:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+21:3440:x1877767531561984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790778812.805795:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778812.805801:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607478c expref: 21 pid: 5943 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.805811:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607478c expref: 21 pid: 5943 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.805825:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165a600/0xdc87632656074793 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607478c expref: 21 pid: 5943 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.805837:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778812.805874:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+20:3440:x1877767531561984:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778812.805891:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790778812.805910:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778812.805917:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531562112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790778812.805926:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778812.805930:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560746c1 expref: 19 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.805939:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560746c1 expref: 19 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.805948:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165a000/0xdc876326560746c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560746c1 expref: 19 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.805956:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778812.805982:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+18:3441:x1877767531562112:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778812.805989:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790778812.806000:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778812.806006:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+17:3441:x1877767531562240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790778812.806014:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778812.806018:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607465f expref: 17 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.806025:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607465f expref: 17 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.806034:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499a00/0xdc87632656074666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607465f expref: 17 pid: 5944 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778812.806060:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778812.806084:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:763f742b-0483-425a-8826-84839ee976ad+16:3441:x1877767531562240:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778812.806090:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778812.806122:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531561984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778812.806146:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531562240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778812.806153:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531562112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778812.810998:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778812.811315:0:8878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8878:1877767531561472:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778812.811356:0:8878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778812.811416:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562432 00000100:00100000:3.0:1790778812.811424:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562432 00010000:00010000:3.0:1790778812.811489:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 10 pid: 5944 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778812.811522:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1790778812.811533:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2345:x1877767510562432:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778812.811549:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778812.811556:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 10 pid: 5944 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812587:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 10 pid: 5944 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812617:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014abc00/0xdc87632656074850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcac2 expref: 10 pid: 5944 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812636:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812645:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812666:0:5934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812674:0:5934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812701:0:5934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812708:0:5934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812714:0:5934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4ca00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778812.812719:0:5934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812727:0:5934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812748:0:5934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778812.812760:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778812.812823:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:2345:x1877767510562432:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1291us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778812.812832:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:2.0:1790778812.813306:0:8878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.813325:0:8878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778812.813332:0:8878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4ca00/0xdc876326560748f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778813.157867:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778813.158238:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562560 00000100:00100000:0.0:1790778813.158249:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562560 00000100:00100000:0.0:1790778813.158315:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:0.0:1790778813.158325:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:5437:x1877767510562560:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778813.158356:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778813.158382:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb01 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778813.158421:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778813.158433:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 10 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778813.158774:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0200, rc 0) 00000100:00100000:0.0:1790778813.158845:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510562560:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 520us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778813.158853:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:0.0:1790778813.170228:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778813.170385:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562688 00000100:00100000:2.0:1790778813.170402:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562688 00000100:00100000:2.0:1790778813.170530:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:2.0:1790778813.170542:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510562688:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778813.170796:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510562688:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 256us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778813.170804:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:1.0:1790778813.179755:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778813.179869:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562816 00000100:00100000:2.0:1790778813.179897:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562816 00000100:00100000:2.0:1790778813.179981:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:2.0:1790778813.179993:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510562816:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778813.180220:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5437:x1877767510562816:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 228us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778813.180229:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 173 00010000:00010000:3.0:1790778813.196656:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778813.200591:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778813.201257:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510562944 00000100:00100000:0.0:1790778813.201271:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510562944 00000100:00100000:0.0:1790778813.201357:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:0.0:1790778813.201388:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5954:x1877767510562944:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778813.201674:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5954:x1877767510562944:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 287us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778813.201683:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:1.0:1790778813.212010:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778813.213012:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563072 00000100:00100000:0.0:1790778813.213028:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563072 00000100:00100000:0.0:1790778813.213108:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:0.0:1790778813.213118:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5954:x1877767510563072:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778813.213544:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:5954:x1877767510563072:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 426us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778813.213555:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00010000:00010000:3.0:1790778814.220707:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790778814.731577:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790778814.731587:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef235b0c800 from 4 10000000:01000000:2.0:1790778814.731592:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790778814.731645:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778814.731658:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778814.731690:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778814.731717:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531562368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778814.731794:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778814.731854:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5780 going to sleep for 11 seconds 00000100:00100000:0.0:1790778814.731988:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562368 00000100:00100000:0.0:1790778814.731999:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562368 00000100:00100000:0.0:1790778814.732059:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790778814.732069:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531562368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778814.732234:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778814.732250:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560748ff expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778814.732283:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560748ff expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778814.732300:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748ff expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778814.732310:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0600, rc 0) 00000100:00100000:0.0:1790778814.732782:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531562368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 713us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778814.732795:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790778814.733379:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531562368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778814.733399:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778814.733409:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778814.733528:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531562496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778814.733566:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778814.733605:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3780 going to sleep for 11 seconds 00000100:00100000:0.0:1790778814.733848:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562496 00000100:00100000:0.0:1790778814.733854:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562496 00000100:00100000:0.0:1790778814.733899:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790778814.733906:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531562496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778814.734049:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531562496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778814.734057:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790778814.734424:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531562496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778814.734532:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531562624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778814.734584:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778814.734665:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5600 going to sleep for 11 seconds 00000100:00100000:0.0:1790778814.736188:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562624 00000100:00100000:0.0:1790778814.736206:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562624 00000100:00100000:1.0:1790778814.738335:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790778814.738363:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531562624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.738591:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531562624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.738601:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790778814.738702:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531562624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.738968:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8957:1877767531562752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.739015:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.739041:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562752 00000100:00100000:1.0:1790778814.739048:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562752 00000100:00100000:1.0:1790778814.739074:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790778814.739093:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:8957:x1877767531562752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.739169:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:8957:x1877767531562752:12345-0@lo:502:llog_process_th.0 Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.739176:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790778814.739218:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.739230:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8957:1877767531562752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778814.739250:0:8957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778814.739260:0:8957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778814.739262:0:8957:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790778814.739269:0:8957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef235b0c800 00000020:00000080:1.0:1790778814.739272:0:8957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790778814.739355:0:8957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8957:1877767531562880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.739389:0:8957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.739407:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531562880 00000100:00100000:1.0:1790778814.739411:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531562880 00000100:00100000:1.0:1790778814.739427:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790778814.739432:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:8957:x1877767531562880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.739510:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:8957:x1877767531562880:12345-0@lo:502:llog_process_th.0 Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.739516:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790778814.739545:0:8957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.739555:0:8957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8957:1877767531562880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778814.739571:0:8957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778814.739576:0:8957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778814.739577:0:8957:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790778814.739581:0:8957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790778814.739632:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790778814.739659:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778814.739671:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.739682:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778814.739693:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790778814.739695:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef2332da000 from 4 10000000:01000000:1.0:1790778814.739698:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778814.739721:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.739729:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.739737:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778814.739750:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.739779:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.739792:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.739804:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563008 00000100:00100000:1.0:1790778814.739807:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563008 00000100:00100000:1.0:1790778814.739825:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790778814.739831:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531563008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778814.739840:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778814.739853:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607490d expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.739904:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607490d expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.739915:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607490d expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.739923:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387400, rc 0) 00000100:00100000:1.0:1790778814.739952:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531563008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.739959:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790778814.739988:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778814.740000:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.740010:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778814.740056:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.740079:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.740093:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.740104:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563136 00000100:00100000:1.0:1790778814.740107:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563136 00000100:00100000:1.0:1790778814.740124:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790778814.740130:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531563136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.740221:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531563136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.740238:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790778814.740268:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.740292:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.740326:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.740340:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.740352:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563264 00000100:00100000:1.0:1790778814.740356:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563264 00000100:00100000:1.0:1790778814.740372:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790778814.740378:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531563264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.740466:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531563264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.740473:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790778814.740510:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.740773:0:8958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8958:1877767531563392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.740807:0:8958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.740826:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563392 00000100:00100000:1.0:1790778814.740830:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563392 00000100:00100000:1.0:1790778814.740848:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790778814.740854:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:8958:x1877767531563392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.740929:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:8958:x1877767531563392:12345-0@lo:502:llog_process_th.0 Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.740935:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790778814.740960:0:8958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a600 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.740970:0:8958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8958:1877767531563392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778814.740996:0:8958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790778814.741003:0:8958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778814.741005:0:8958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790778814.741011:0:8958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef2332da000 00000020:00000080:1.0:1790778814.741013:0:8958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790778814.741071:0:8958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8958:1877767531563520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.741101:0:8958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.741120:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563520 00000100:00100000:1.0:1790778814.741123:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563520 00000100:00100000:1.0:1790778814.741140:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790778814.741146:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:8958:x1877767531563520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.741202:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:8958:x1877767531563520:12345-0@lo:502:llog_process_th.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.741209:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790778814.741237:0:8958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.741248:0:8958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8958:1877767531563520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790778814.741267:0:8958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790778814.741272:0:8958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790778814.741274:0:8958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790778814.741278:0:8958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790778814.741324:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790778814.741346:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778814.741355:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741365:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778814.741389:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790778814.741392:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef211145000 from 4 10000000:01000000:1.0:1790778814.741395:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778814.741418:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741426:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741433:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778814.741477:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.741503:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.741517:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.741530:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563648 00000100:00100000:1.0:1790778814.741533:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563648 00000100:00100000:1.0:1790778814.741552:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790778814.741558:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531563648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778814.741566:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778814.741577:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607491b expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741594:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607491b expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741603:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607491b expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741621:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386600, rc 0) 00000100:00100000:1.0:1790778814.741652:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531563648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.741659:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790778814.741685:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778814.741699:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.741708:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778814.741746:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.741769:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778814.741781:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.741792:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563776 00000100:00100000:1.0:1790778814.741795:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563776 00000100:00100000:1.0:1790778814.741810:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790778814.741815:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531563776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778814.751657:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531563776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9829us (9874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.751672:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790778814.751831:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778814.751907:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778814.751976:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778814.752021:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef203020300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778814.753050:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531563904 00000100:00100000:3.0:1790778814.753061:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531563904 00000100:00100000:3.0:1790778814.753134:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790778814.753144:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531563904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778814.753501:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531563904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778814.753509:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790778814.753609:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531563904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778814.754587:0:8960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8960:1877767531564032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778814.754647:0:8960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778814.754693:0:8960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80da80 going to sleep for 11 seconds 00000100:00100000:1.0:1790778814.754752:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564032 00000100:00100000:1.0:1790778814.754759:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564032 00000100:00100000:1.0:1790778814.754795:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790778814.754810:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:8960:x1877767531564032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778814.754929:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:8960:x1877767531564032:12345-0@lo:502:llog_process_th.0 Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778814.754945:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790778814.755414:0:8960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8960:1877767531564032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778814.755486:0:8960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790778814.755498:0:8960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778814.755501:0:8960:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790778814.755508:0:8960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef211145000 00000020:00000080:0.0:1790778814.755511:0:8960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790778814.755604:0:8960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8960:1877767531564160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778814.755644:0:8960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778814.755678:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564160 00000100:00100000:0.0:1790778814.755683:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564160 00000100:00100000:0.0:1790778814.755710:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790778814.755717:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:8960:x1877767531564160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778814.755788:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:8960:x1877767531564160:12345-0@lo:502:llog_process_th.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778814.755795:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790778814.755839:0:8960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206beaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778814.755852:0:8960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:8960:1877767531564160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790778814.755887:0:8960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790778814.755892:0:8960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790778814.755894:0:8960:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790778814.755897:0:8960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790778814.758291:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790778814.758475:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778814.758487:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778814.758500:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778815.245069:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778816.268796:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778816.527462:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531564544:0@lo:400:kworker.0 00000100:00100000:3.0:1790778816.527568:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778816.527659:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778816.527666:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531564672:0@lo:400:kworker.0 00000100:00100000:3.0:1790778816.527695:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778816.527743:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564544 00000100:00100000:3.0:1790778816.527753:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564544 00000100:00100000:3.0:1790778816.527822:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778816.527833:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531564544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778816.527906:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531564544:12345-0@lo:400:kworker.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778816.527915:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778816.527941:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564672 00000100:00100000:3.0:1790778816.527945:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564672 00000100:00100000:3.0:1790778816.527981:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778816.527987:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531564672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778816.528019:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531564672:12345-0@lo:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778816.528025:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1790778816.528061:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778816.528067:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790778816.528107:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c01c00 x1877767531564672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778816.528123:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531564672:0@lo:400:kworker.0 00000100:00100000:3.0:1790778816.528135:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531564544:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.530834:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531564416:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.530964:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778816.531021:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531564928:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.531285:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778816.531323:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790778816.531331:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531564288:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.531364:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778816.531410:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531564800:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.531435:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778816.531522:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564928 00000100:00100000:2.0:1790778816.531533:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564928 00000100:00100000:2.0:1790778816.531608:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778816.531621:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531564928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.531701:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531564928:12345-0@lo:400:kworker.0 Request processed in 82us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778816.531728:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778816.531765:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564416 00000100:00100000:2.0:1790778816.531770:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564416 00000100:00100000:2.0:1790778816.531794:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564800 00000100:00100000:2.0:1790778816.531796:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564800 00000100:00100000:2.0:1790778816.531818:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790778816.531824:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531564416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.531871:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531564416:12345-0@lo:400:kworker.0 Request processed in 46us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778816.531878:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790778816.531890:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790778816.531896:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531564800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.531921:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531564800:12345-0@lo:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778816.531926:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790778816.532300:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531564288 00000100:00100000:0.0:1790778816.532305:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531564288 00000100:00100000:0.0:1790778816.532338:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790778816.532346:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531564288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778816.532387:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531564288:12345-0@lo:400:kworker.0 Request processed in 42us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778816.532393:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790778816.532989:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531565184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778816.533246:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778816.533292:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778816.533300:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531565056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778816.533326:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790778816.533362:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778816.533369:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778816.535007:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565184 00000100:00100000:2.0:1790778816.535026:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565184 00000100:00100000:2.0:1790778816.535309:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565056 00000100:00100000:2.0:1790778816.535313:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565056 00000100:00100000:2.0:1790778816.535335:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790778816.535346:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531565184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790778816.535401:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778816.535572:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531565184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778816.535581:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790778816.535609:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790778816.535616:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531565056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778816.535658:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778816.535691:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531565056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778816.535697:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790778816.535763:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e3b800 x1877767531565056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778816.535792:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531565056:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790778816.535808:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236544700 x1877767531565184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778816.535820:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531565184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778816.535889:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531564288:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.535908:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531564800:0@lo:400:kworker.0 00000100:00100000:2.0:1790778816.535925:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531564416:0@lo:400:kworker.0 00010000:00080000:2.0:1790778816.535938:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236544000 x1877767531564928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778816.535948:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531564928:0@lo:400:kworker.0 00000100:00100000:1.0:1790778816.845686:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778816.845741:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778816.845775:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778816.845810:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778816.845877:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563456 00000100:00100000:1.0:1790778816.845890:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563456 00000100:00100000:1.0:1790778816.845966:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563584 00000100:00100000:1.0:1790778816.845970:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563584 00000100:00100000:1.0:1790778816.845991:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1790778816.846002:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510563456:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778816.846103:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510563456:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778816.846112:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1790778816.846133:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1790778816.846139:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510563584:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778816.846176:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510563584:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778816.846181:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00080000:1.0:1790778816.846201:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778816.846206:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778816.846356:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563328 00000100:00100000:1.0:1790778816.846361:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563328 00000100:00100000:1.0:1790778816.846399:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1790778816.846405:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510563328:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778816.846772:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510563328:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778816.846782:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00080000:1.0:1790778816.846825:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778816.847590:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563200 00000100:00100000:0.0:1790778816.847599:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563200 00000100:00100000:0.0:1790778816.847642:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:0.0:1790778816.847649:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2344:x1877767510563200:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778816.847705:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2344:x1877767510563200:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 56us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778816.847711:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 192 00010000:00010000:3.0:1790778817.294209:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778818.318971:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778819.340635:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778820.372575:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790778820.416890:0:9176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1790778821.388937:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778821.643889:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531565568:0@lo:400:kworker.0 00000100:00100000:3.0:1790778821.643987:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778821.644078:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778821.644086:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531565696:0@lo:400:kworker.0 00000100:00100000:3.0:1790778821.644116:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778821.644166:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565696 00000100:00100000:3.0:1790778821.644190:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565696 00000100:00100000:3.0:1790778821.644245:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790778821.644255:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531565696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778821.644311:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531565696:12345-0@lo:400:kworker.0 Request processed in 57us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778821.644318:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790778821.644341:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778821.644372:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e3bb80 x1877767531565696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778821.644386:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531565696:0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644486:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531565312:0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644522:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778821.644552:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531565824:0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644575:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778821.644595:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790778821.644600:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531565440:0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644622:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778821.644640:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531565952:0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644662:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778821.644687:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565568 00000100:00100000:1.0:1790778821.644691:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565568 00000100:00100000:1.0:1790778821.644721:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565824 00000100:00100000:1.0:1790778821.644730:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565824 00000100:00100000:1.0:1790778821.644747:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565440 00000100:00100000:1.0:1790778821.644749:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565440 00000100:00100000:1.0:1790778821.644761:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790778821.644767:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531565568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644815:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531565568:12345-0@lo:400:kworker.0 Request processed in 48us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778821.644821:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790778821.644833:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790778821.644839:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531565824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644874:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531565824:12345-0@lo:400:kworker.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778821.644880:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790778821.644890:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790778821.644895:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531565440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.644919:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531565440:12345-0@lo:400:kworker.0 Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778821.644924:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790778821.644943:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565952 00000100:00100000:1.0:1790778821.644947:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565952 00000100:00100000:1.0:1790778821.644968:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778821.644975:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531565952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.645006:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531565952:12345-0@lo:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778821.645012:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790778821.645040:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531565440:0@lo:400:kworker.0 00010000:00080000:1.0:1790778821.645062:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e38700 x1877767531565952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778821.645072:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531565952:0@lo:400:kworker.0 00000100:00100000:1.0:1790778821.645081:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531565824:0@lo:400:kworker.0 00000100:00100000:3.0:1790778821.645178:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531565312 00000100:00100000:3.0:1790778821.645183:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531565312 00000100:00100000:3.0:1790778821.645210:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790778821.645217:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778821.645255:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531565312:12345-0@lo:400:kworker.0 Request processed in 40us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778821.645262:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1790778821.645284:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778821.645288:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778821.645302:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531565312:0@lo:400:kworker.0 00000100:00100000:3.0:1790778821.645322:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531565568:0@lo:400:kworker.0 00000100:00100000:2.0:1790778821.645610:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778821.645621:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531566080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778821.645655:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778821.645767:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778821.645776:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531566208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778821.645812:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778821.645839:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566080 00000100:00100000:3.0:1790778821.645843:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566080 00000100:00100000:3.0:1790778821.645873:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566208 00000100:00100000:3.0:1790778821.645876:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566208 00000100:00100000:3.0:1790778821.645891:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790778821.645897:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531566080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778821.645922:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778821.645954:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531566080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778821.645961:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790778821.645971:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790778821.645977:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531566208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778821.645991:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778821.646022:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531566208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778821.646028:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790778821.646056:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236545500 x1877767531566208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778821.646071:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531566208:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790778821.646496:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e39500 x1877767531566080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778821.646511:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531566080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778821.970843:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778821.970876:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778821.970900:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778821.970921:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778821.970948:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564096 00000100:00100000:2.0:1790778821.970958:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564096 00000100:00100000:2.0:1790778821.971009:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563968 00000100:00100000:2.0:1790778821.971012:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563968 00000100:00100000:2.0:1790778821.971027:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1790778821.971036:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510564096:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778821.971108:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510564096:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778821.971116:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1790778821.971134:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1790778821.971140:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510563968:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778821.971159:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510563968:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 19us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778821.971165:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1790778821.971180:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563712 00000100:00100000:2.0:1790778821.971183:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563712 00000100:00100000:2.0:1790778821.971219:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:2.0:1790778821.971225:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2345:x1877767510563712:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778821.971246:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2345:x1877767510563712:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778821.971267:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00080000:2.0:1790778821.971290:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778821.971294:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778821.971406:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510563840 00000100:00100000:2.0:1790778821.971410:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510563840 00000100:00100000:2.0:1790778821.971462:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1790778821.971470:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510563840:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778821.971508:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510563840:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778821.971514:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00080000:2.0:1790778821.971531:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778822.412638:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778823.436722:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778824.459659:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778825.483847:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790778825.522846:0:9419:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing yml_node 00010000:00010000:2.0:1790778826.510536:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778826.763995:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531566720:0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.765506:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778826.765611:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790778826.765624:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531566592:0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.765676:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778826.765703:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531567104:0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.765733:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778826.765806:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566720 00000100:00100000:0.0:1790778826.765815:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566720 00000100:00100000:0.0:1790778826.765874:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566592 00000100:00100000:0.0:1790778826.765877:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566592 00000100:00100000:0.0:1790778826.765903:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790778826.765914:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531566720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.765987:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531566720:12345-0@lo:400:kworker.0 Request processed in 74us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778826.765995:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790778826.766013:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778826.766020:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531566592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.766049:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531566592:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778826.766056:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778826.766075:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567104 00000100:00100000:0.0:1790778826.766079:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567104 00000100:00100000:0.0:1790778826.766106:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790778826.766113:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531567104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.766146:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531567104:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778826.766176:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1790778826.766197:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790778826.766203:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778826.766251:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531566592:0@lo:400:kworker.0 00010000:00080000:0.0:1790778826.766265:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e3b800 x1877767531567104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778826.766276:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531567104:0@lo:400:kworker.0 00000100:00100000:0.0:1790778826.766287:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531566720:0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.766656:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531566464:0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.766699:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778826.766733:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531566976:0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.766773:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778826.766797:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790778826.766803:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531566336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778826.766831:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778826.766850:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531566848:0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.766871:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778826.766913:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566848 00000100:00100000:2.0:1790778826.766918:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566848 00000100:00100000:2.0:1790778826.766959:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790778826.766967:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531566848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.767019:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531566848:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778826.767026:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1790778826.767043:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778826.767067:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e3b100 x1877767531566848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778826.767078:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531566848:0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.767097:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566976 00000100:00100000:2.0:1790778826.767100:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566976 00000100:00100000:2.0:1790778826.767126:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790778826.767132:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531566976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778826.767165:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531566976:12345-0@lo:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778826.767171:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1790778826.767184:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778826.767200:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531566976:0@lo:400:kworker.0 00000100:00100000:3.0:1790778826.767387:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566336 00000100:00100000:3.0:1790778826.767392:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566336 00000100:00100000:3.0:1790778826.767420:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778826.767427:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531566336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778826.767476:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778826.767521:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531566336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778826.767539:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790778826.767559:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778826.767568:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531567232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778826.767599:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778826.767627:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567232 00000100:00100000:3.0:1790778826.767631:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567232 00000100:00100000:3.0:1790778826.767653:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790778826.767660:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531567232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778826.767678:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778826.767712:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531567232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778826.767719:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790778826.767741:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236547100 x1877767531567232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778826.767765:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531567232:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790778826.767796:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236545500 x1877767531566336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778826.767813:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531566336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778826.770162:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531566464 00000100:00100000:1.0:1790778826.770180:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531566464 00000100:00100000:1.0:1790778826.770279:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790778826.770291:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531566464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778826.770386:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531566464:12345-0@lo:400:kworker.0 Request processed in 98us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778826.770393:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790778826.770489:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531566464:0@lo:400:kworker.0 00000100:00100000:2.0:1790778827.100548:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778827.100594:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778827.100631:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778827.101080:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564352 00000100:00100000:1.0:1790778827.101090:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564352 00000100:00100000:1.0:1790778827.101151:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:1.0:1790778827.101161:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510564352:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778827.101312:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510564352:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 151us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778827.101320:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1790778827.101496:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564224 00000100:00100000:3.0:1790778827.101501:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564224 00000100:00100000:3.0:1790778827.101536:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:3.0:1790778827.101544:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2344:x1877767510564224:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778827.101573:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2344:x1877767510564224:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778827.101596:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:0.0:1790778827.102098:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564480 00000100:00100000:0.0:1790778827.102104:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564480 00000100:00100000:0.0:1790778827.102255:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1790778827.102265:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2342:x1877767510564480:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:0.0:1790778827.102295:0:6934:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607485e 00000100:00080000:0.0:1790778827.102304:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef236265000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790778827.102352:0:6934:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790778827.102507:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+2:2342:x1877767510564480:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 244us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778827.102515:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:0.0:1790778827.102535:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778827.102795:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00080000:2.0:1790778827.103067:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778827.103073:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778827.103985:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564608 00000100:00100000:3.0:1790778827.103995:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564608 00000100:00100000:3.0:1790778827.104068:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1790778827.104078:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2342:x1877767510564608:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:3.0:1790778827.104111:0:6935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074865 00000100:00080000:3.0:1790778827.104119:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef236265800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790778827.104160:0:6935:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790778827.104304:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+2:2342:x1877767510564608:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 227us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778827.104311:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00010000:00010000:3.0:1790778827.104331:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790778827.105053:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790778827.535141:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778828.556314:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778829.582375:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790778829.643877:0:9603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00010000:00010000:2.0:1790778830.615354:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778831.632846:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778831.883918:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531567360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778831.885475:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778831.887529:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531567488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778831.888999:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778831.890603:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531568000:0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.890679:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778831.890725:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778831.890731:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531567872:0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.890751:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778831.890777:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568000 00000100:00100000:1.0:1790778831.890786:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568000 00000100:00100000:1.0:1790778831.890840:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567872 00000100:00100000:1.0:1790778831.890843:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567872 00000100:00100000:1.0:1790778831.890863:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790778831.890870:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531568000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.890919:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531568000:12345-0@lo:400:kworker.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778831.890927:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790778831.890944:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778831.890949:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531567872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.890970:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531567872:12345-0@lo:400:kworker.0 Request processed in 21us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778831.890975:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778831.891009:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531567872:0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.891019:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531568000:0@lo:400:kworker.0 00000100:00100000:0.0:1790778831.891280:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531567616:0@lo:400:kworker.0 00000100:00100000:0.0:1790778831.891341:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778831.891382:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778831.891389:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531567744:0@lo:400:kworker.0 00000100:00100000:0.0:1790778831.891409:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778831.891439:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567744 00000100:00100000:0.0:1790778831.891465:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567744 00000100:00100000:0.0:1790778831.891490:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790778831.891496:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531567744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778831.891527:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531567744:12345-0@lo:400:kworker.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778831.891533:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790778831.891557:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531567744:0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.893941:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567616 00000100:00100000:1.0:1790778831.893963:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567616 00000100:00100000:1.0:1790778831.894040:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790778831.894054:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531567616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778831.894153:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531567616:12345-0@lo:400:kworker.0 Request processed in 103us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778831.894183:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1790778831.894248:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778831.894425:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531567616:0@lo:400:kworker.0 00000100:00100000:3.0:1790778831.896833:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567360 00000100:00100000:3.0:1790778831.896853:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567360 00000100:00100000:3.0:1790778831.896939:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531567488 00000100:00100000:3.0:1790778831.896943:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531567488 00000100:00100000:3.0:1790778831.896966:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790778831.896977:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531567360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778831.897026:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778831.897152:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531567360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (11684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778831.897160:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790778831.897179:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790778831.897185:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531567488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778831.897206:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778831.897261:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531567488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (8268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778831.897266:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1790778831.897343:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e38700 x1877767531567488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778831.897363:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531567488:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790778831.897400:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236545500 x1877767531567360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778831.897412:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531567360:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790778831.897777:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778831.897783:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778832.207996:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778832.208062:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778832.208232:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564736 00000100:00100000:2.0:1790778832.208242:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564736 00000100:00100000:2.0:1790778832.208303:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:2.0:1790778832.208315:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510564736:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778832.208375:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564864 00000100:00100000:1.0:1790778832.208381:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564864 00000100:00100000:2.0:1790778832.208394:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510564736:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778832.208403:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:1.0:1790778832.208433:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1790778832.208464:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510564864:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778832.208507:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510564864:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 67us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778832.208514:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00080000:1.0:1790778832.208530:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1790778832.611833:0:9701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00010000:00010000:3.0:1790778832.656959:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790778832.912571:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:0.0:1790778832.912583:0:6930:0:(genops.c:885:class_export_put()) final put ffff9ef236264800/b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:1.0:1790778832.913868:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef236264800/b53b344e-0d4c-4209-a606-d24036760c61 for lustre-OST0000 00000020:00000080:1.0:1790778832.914066:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef236265000 for lustre-OST0000 00000001:00100000:2.0:1790778832.922953:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:2.0:1790778832.922963:0:8008:0:(genops.c:885:class_export_put()) final put ffff9ef236260000/b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:0.0:1790778832.923273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef236260000/b53b344e-0d4c-4209-a606-d24036760c61 for lustre-OST0001 00000020:00000080:0.0:1790778832.923328:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef236265800 for lustre-OST0001 00010000:00010000:2.0:1790778833.676701:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778834.699650:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790778835.506983:0:9799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:3.0:1790778835.723699:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778836.769673:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778837.007889:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531568256:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.007986:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.008051:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531568768:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008078:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.008113:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790778837.008120:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531568128:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008149:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.008173:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531568640:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008196:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.008224:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531568384:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008246:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.008273:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778837.008278:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531568512:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008300:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.008330:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568256 00000100:00100000:1.0:1790778837.008338:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568256 00000100:00100000:1.0:1790778837.008379:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568640 00000100:00100000:1.0:1790778837.008382:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568640 00000100:00100000:1.0:1790778837.008402:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568384 00000100:00100000:1.0:1790778837.008405:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568384 00000100:00100000:1.0:1790778837.008420:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778837.008429:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531568256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008510:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531568256:12345-0@lo:400:kworker.0 Request processed in 82us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.008517:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790778837.008533:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790778837.008540:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531568640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008568:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531568640:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.008574:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790778837.008584:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790778837.008590:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531568384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008620:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531568384:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.008626:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790778837.008646:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568768 00000100:00100000:1.0:1790778837.008661:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568768 00000100:00100000:1.0:1790778837.008686:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568512 00000100:00100000:1.0:1790778837.008690:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568512 00000100:00100000:1.0:1790778837.008714:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778837.008720:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531568768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008754:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531568768:12345-0@lo:400:kworker.0 Request processed in 34us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.008760:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790778837.008771:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790778837.008777:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531568512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008804:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531568512:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.008810:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1790778837.008831:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790778837.008835:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778837.008837:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790778837.008862:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d75880 x1877767531568512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778837.008875:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531568512:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008884:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531568384:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008916:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531568640:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008926:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531568256:0@lo:400:kworker.0 00010000:00080000:1.0:1790778837.008937:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236614380 x1877767531568768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778837.008945:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531568768:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.008985:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568128 00000100:00100000:1.0:1790778837.008989:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568128 00000100:00100000:1.0:1790778837.009075:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790778837.009082:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531568128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.009118:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531568128:12345-0@lo:400:kworker.0 Request processed in 36us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.009124:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790778837.009165:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531568128:0@lo:400:kworker.0 00000100:00100000:1.0:1790778837.010082:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778837.010099:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531568896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778837.010159:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778837.010206:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531568896 00000100:00100000:1.0:1790778837.010212:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531568896 00000100:00100000:1.0:1790778837.010250:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790778837.010258:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531568896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778837.010284:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778837.010326:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531568896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.010333:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1790778837.010365:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236614380 x1877767531568896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778837.010382:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531568896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778837.023079:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531569024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778837.023166:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778837.023265:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569024 00000100:00100000:2.0:1790778837.023275:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569024 00000100:00100000:2.0:1790778837.023330:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790778837.023341:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531569024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778837.023375:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778837.023429:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531569024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778837.023436:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1790778837.023544:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235c9c380 x1877767531569024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778837.023563:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531569024:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790778837.199236:0:9847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 30 10:33:55 EDT 2026 00000100:00100000:2.0:1790778837.325995:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778837.326039:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778837.326098:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510564992 00000100:00100000:3.0:1790778837.326109:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510564992 00000100:00100000:3.0:1790778837.326170:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:3.0:1790778837.326179:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510564992:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778837.326261:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510564992:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778837.326269:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:1.0:1790778837.326786:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565120 00000100:00100000:1.0:1790778837.326792:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565120 00000100:00100000:1.0:1790778837.328613:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1790778837.328626:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510565120:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778837.328717:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510565120:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 93us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778837.328725:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00080000:2.0:1790778837.330576:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778837.771867:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778838.799233:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778839.820584:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778840.844849:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778841.868703:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778842.124084:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531569152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778842.124206:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778842.124491:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531569280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778842.124541:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778842.124595:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569152 00000100:00100000:2.0:1790778842.124625:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569152 00000100:00100000:2.0:1790778842.124690:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569280 00000100:00100000:2.0:1790778842.124694:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569280 00000100:00100000:2.0:1790778842.124714:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790778842.124723:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531569152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778842.124763:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778842.130693:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790778842.130835:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531569152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6108us (6632us total) trans 0 rc 0/0 00010000:00080000:3.0:1790778842.130899:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235c9c380 x1877767531569152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778842.130928:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531569152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778842.130953:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778842.130966:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531569664:0@lo:400:kworker.0 00000100:00100000:3.0:1790778842.131112:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778842.131648:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531569792:0@lo:400:kworker.0 00000100:00100000:0.0:1790778842.131648:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531569408:0@lo:400:kworker.0 00000100:00100000:3.0:1790778842.131682:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778842.131685:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778842.131716:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778842.131723:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531569536:0@lo:400:kworker.0 00000100:00100000:2.0:1790778842.131792:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790778842.131803:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531569280:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790778842.131831:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778842.131838:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778842.131884:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569664 00000100:00100000:2.0:1790778842.131894:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569664 00000100:00100000:2.0:1790778842.131942:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569792 00000100:00100000:2.0:1790778842.131945:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569792 00000100:00100000:2.0:1790778842.131962:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790778842.131969:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531569664:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790778842.132065:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778842.132153:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531569664:12345-0@lo:400:kworker.0 Request processed in 184us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778842.132162:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790778842.132174:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790778842.132181:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531569792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778842.132210:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531569792:12345-0@lo:400:kworker.0 Request processed in 29us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778842.132216:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790778842.132416:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569408 00000100:00100000:2.0:1790778842.132421:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569408 00000100:00100000:2.0:1790778842.132485:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790778842.132493:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531569408:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1790778842.132498:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778842.132542:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531569408:12345-0@lo:400:kworker.0 Request processed in 51us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778842.132549:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790778842.132553:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531569280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 761us (8011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778842.132559:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790778842.132616:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236617b80 x1877767531569280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778842.132638:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531569280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778842.132724:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778842.132761:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531569408:0@lo:400:kworker.0 00000100:00100000:2.0:1790778842.133010:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569536 00000100:00100000:2.0:1790778842.133015:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569536 00000100:00100000:2.0:1790778842.133047:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790778842.133055:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531569536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778842.133100:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531569536:12345-0@lo:400:kworker.0 Request processed in 46us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778842.133108:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790778842.133645:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531569536:0@lo:400:kworker.0 00000100:00100000:3.0:1790778842.133907:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531569664:0@lo:400:kworker.0 00000100:00100000:2.0:1790778842.134088:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531569792:0@lo:400:kworker.0 00000100:00100000:2.0:1790778842.445054:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778842.445112:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778842.445214:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565248 00000100:00100000:1.0:1790778842.445227:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565248 00000100:00100000:1.0:1790778842.445292:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:1.0:1790778842.445304:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2344:x1877767510565248:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778842.445398:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2344:x1877767510565248:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 96us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778842.445408:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:3.0:1790778842.445498:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565376 00000100:00100000:3.0:1790778842.445503:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565376 00000100:00100000:3.0:1790778842.445553:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1790778842.445561:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510565376:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778842.445609:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510565376:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 38us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778842.445616:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00080000:1.0:1790778842.446201:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778842.892158:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778843.923952:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778844.939718:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778845.199605:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531569920:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.199715:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778845.199781:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531570432:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.199814:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778845.199847:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790778845.199854:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531570048:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.199879:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778845.199899:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531570560:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.199928:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778845.199961:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531570304:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200018:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778845.200042:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778845.200048:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531570176:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200073:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778845.200119:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531569920 00000100:00100000:0.0:1790778845.200130:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531569920 00000100:00100000:0.0:1790778845.200189:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790778845.200199:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531569920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200336:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531569920:12345-0@lo:400:kworker.0 Request processed in 137us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778845.200346:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790778845.200386:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570432 00000100:00100000:0.0:1790778845.200390:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570432 00000100:00100000:0.0:1790778845.200432:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570048 00000100:00100000:0.0:1790778845.200436:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570048 00000100:00100000:0.0:1790778845.200473:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570176 00000100:00100000:0.0:1790778845.200485:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570176 00000100:00100000:0.0:1790778845.200504:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790778845.200511:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531570432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200547:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531570432:12345-0@lo:400:kworker.0 Request processed in 38us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778845.200554:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790778845.200566:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790778845.200583:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531570048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200611:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531570048:12345-0@lo:400:kworker.0 Request processed in 29us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778845.200617:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790778845.200628:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790778845.200634:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531570176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200667:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531570176:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778845.200673:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790778845.200712:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531570176:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200750:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531570048:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200759:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531569920:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.200769:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531570432:0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.205256:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570560 00000100:00100000:0.0:1790778845.205279:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570560 00000100:00100000:0.0:1790778845.205377:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570304 00000100:00100000:0.0:1790778845.205381:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570304 00000100:00100000:0.0:1790778845.205407:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790778845.205456:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531570560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.205601:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531570560:12345-0@lo:400:kworker.0 Request processed in 164us (5670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778845.205608:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790778845.205631:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790778845.205637:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531570304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778845.205677:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531570304:12345-0@lo:400:kworker.0 Request processed in 40us (5658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778845.205684:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1790778845.205753:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e3b100 x1877767531570304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778845.205771:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531570304:0@lo:400:kworker.0 00010000:00080000:0.0:1790778845.205820:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef235e38700 x1877767531570560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778845.205831:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531570560:0@lo:400:kworker.0 00000100:00080000:1.0:1790778845.210309:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790778845.210319:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778845.210324:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778845.963793:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778846.996084:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778847.243641:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778847.243679:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531570688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778847.243781:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778847.243933:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570688 00000100:00100000:1.0:1790778847.243945:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570688 00000100:00100000:1.0:1790778847.244036:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790778847.244049:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531570688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778847.244090:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778847.244168:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531570688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778847.244176:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1790778847.244230:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236617b80 x1877767531570688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778847.244254:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531570688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790778847.244328:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778847.248366:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778847.248401:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531570816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778847.248726:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778847.248851:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570816 00000100:00100000:2.0:1790778847.248862:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570816 00000100:00100000:2.0:1790778847.248938:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790778847.248949:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531570816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778847.248990:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778847.249043:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531570816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778847.249050:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1790778847.253164:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236617b80 x1877767531570816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778847.253200:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531570816:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790778847.253258:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778847.566536:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778847.566606:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778847.566619:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565632 00000100:00100000:0.0:1790778847.566639:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565632 00000100:00100000:0.0:1790778847.566727:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1790778847.566741:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510565632:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778847.566847:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510565632:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778847.566856:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00080000:0.0:1790778847.566887:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778847.567029:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565504 00000100:00100000:2.0:1790778847.567035:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565504 00000100:00100000:2.0:1790778847.567089:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:2.0:1790778847.567097:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510565504:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778847.567129:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510565504:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778847.567137:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 204 00010000:00010000:3.0:1790778848.014041:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778849.038809:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778850.062473:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778850.322854:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531570944:0@lo:400:kworker.0 00000100:00100000:0.0:1790778850.323242:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778850.329766:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531570944 00000100:00100000:1.0:1790778850.329787:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531570944 00000100:00100000:1.0:1790778850.329861:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790778850.329873:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531570944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.332276:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531571072:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.332338:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778850.332375:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531571584:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.332397:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778850.332477:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778850.332483:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531571456:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.332505:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778850.332542:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531571200:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.332569:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778850.335203:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531570944:12345-0@lo:400:kworker.0 Request processed in 5315us (11945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778850.335226:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790778850.335400:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571584 00000100:00100000:1.0:1790778850.335424:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571584 00000100:00100000:1.0:1790778850.335568:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790778850.335589:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531571584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778850.335837:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531571584:12345-0@lo:400:kworker.0 Request processed in 259us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778850.335844:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1790778850.335880:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778850.339248:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531570944:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.342762:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778850.342799:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531571328:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.342903:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778850.346278:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571072 00000100:00100000:3.0:1790778850.346300:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571072 00000100:00100000:3.0:1790778850.346380:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571456 00000100:00100000:3.0:1790778850.346384:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571456 00000100:00100000:3.0:1790778850.346409:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571200 00000100:00100000:3.0:1790778850.346413:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571200 00000100:00100000:3.0:1790778850.346436:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790778850.346480:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531571072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.346725:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531571072:12345-0@lo:400:kworker.0 Request processed in 249us (14387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778850.346735:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790778850.346758:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790778850.346765:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531571456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.346799:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531571456:12345-0@lo:400:kworker.0 Request processed in 36us (14293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778850.346806:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790778850.346816:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778850.346822:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531571200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.346854:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531571200:12345-0@lo:400:kworker.0 Request processed in 32us (14284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778850.346878:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778850.347187:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531571456:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.347208:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531571072:0@lo:400:kworker.0 00010000:00080000:3.0:1790778850.347225:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236544000 x1877767531571584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778850.347237:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531571584:0@lo:400:kworker.0 00000100:00100000:3.0:1790778850.347293:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531571200:0@lo:400:kworker.0 00000100:00080000:3.0:1790778850.347312:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778850.353428:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571328 00000100:00100000:1.0:1790778850.353471:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571328 00000100:00100000:1.0:1790778850.353578:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790778850.353602:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531571328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778850.353759:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531571328:12345-0@lo:400:kworker.0 Request processed in 160us (10856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778850.353768:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1790778850.353845:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236545180 x1877767531571328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778850.353867:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531571328:0@lo:400:kworker.0 00000100:00080000:3.0:1790778850.356596:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790778851.089961:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778852.109652:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778852.363788:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531571712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778852.363897:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778852.364538:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571712 00000100:00100000:2.0:1790778852.364552:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571712 00000100:00100000:2.0:1790778852.364651:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790778852.364662:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531571712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790778852.364704:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1790778852.364861:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778852.364892:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531571840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778852.364931:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778852.364984:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571840 00000100:00100000:0.0:1790778852.364988:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571840 00000100:00100000:0.0:1790778852.365015:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790778852.365023:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531571840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778852.365042:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778852.365079:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531571840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778852.365087:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1790778852.365110:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790778852.365153:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236617800 x1877767531571840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778852.365176:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531571840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778852.371071:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531571712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6395us (7157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778852.371091:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790778852.374809:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236614e00 x1877767531571712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778852.374852:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531571712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778852.686524:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778852.686587:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778852.686706:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565760 00000100:00100000:1.0:1790778852.686720:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565760 00000100:00100000:1.0:1790778852.686793:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:1.0:1790778852.686805:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2345:x1877767510565760:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778852.686897:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2345:x1877767510565760:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778852.686906:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:3.0:1790778852.687479:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510565888 00000100:00100000:3.0:1790778852.687488:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510565888 00000100:00100000:3.0:1790778852.687566:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:3.0:1790778852.687574:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510565888:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778852.687637:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510565888:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 64us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778852.687644:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00080000:1.0:1790778852.688811:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778853.133486:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790778853.622070:0:10476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:34:12 (1790778852) === 00000100:00100000:2.0:1790778854.086260:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778854.086408:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566016 00000100:00100000:1.0:1790778854.086439:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566016 00000100:00100000:1.0:1790778854.086717:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:1.0:1790778854.086730:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:7937:x1877767510566016:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790778854.086758:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778854.086786:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236387000/0xdc87632656074929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb08 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778854.086829:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236387000/0xdc87632656074929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb08 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778854.086843:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236387000/0xdc87632656074929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb08 expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778854.086858:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387000, rc 0) 00000100:00100000:1.0:1790778854.086957:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7937:x1877767510566016:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 229us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778854.086965:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:3.0:1790778854.090968:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778854.092248:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566144 00000100:00100000:2.0:1790778854.092266:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566144 00000100:00100000:2.0:1790778854.092360:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:2.0:1790778854.092372:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7937:x1877767510566144:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790778854.094992:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7937:x1877767510566144:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 2604us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778854.095012:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:3.0:1790778854.099057:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778854.100042:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566272 00000100:00100000:2.0:1790778854.100086:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566272 00000100:00100000:2.0:1790778854.100252:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:2.0:1790778854.100268:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7937:x1877767510566272:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790778854.100569:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7937:x1877767510566272:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 303us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778854.100579:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:3.0:1790778854.113380:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778854.118413:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566400 00000100:00100000:1.0:1790778854.118459:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566400 00000100:00100000:1.0:1790778854.118577:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:1.0:1790778854.118592:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7941:x1877767510566400:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790778854.120528:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7941:x1877767510566400:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 1925us (7149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778854.120545:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:3.0:1790778854.150262:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778854.150512:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566528 00000100:00100000:2.0:1790778854.150528:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566528 00000100:00100000:2.0:1790778854.150613:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:2.0:1790778854.150628:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7941:x1877767510566528:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790778854.150889:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7941:x1877767510566528:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 265us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778854.150899:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 211 00010000:00010000:3.0:1790778854.155647:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778854.158658:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778854.158854:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566656 00000100:00100000:1.0:1790778854.158871:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566656 00000100:00100000:1.0:1790778854.158949:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:1.0:1790778854.158962:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:7937:x1877767510566656:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790778854.159013:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778854.159043:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236386200/0xdc87632656074930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb32 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778854.159085:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236386200/0xdc87632656074930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb32 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778854.159101:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236386200/0xdc87632656074930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb32 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778854.159114:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386200, rc 0) 00000100:00100000:1.0:1790778854.159210:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:7937:x1877767510566656:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 250us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778854.159219:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:3.0:1790778854.163043:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778854.163350:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566784 00000100:00100000:0.0:1790778854.163365:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566784 00000100:00100000:0.0:1790778854.163492:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:0.0:1790778854.163507:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:7937:x1877767510566784:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790778854.163544:0:5942:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790778854.163577:0:5942:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790778854.163582:0:5942:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790778854.163586:0:5942:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790778854.163589:0:5942:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790778854.165886:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:7937:x1877767510566784:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 2353us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778854.165906:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:3.0:1790778854.168844:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778854.170583:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510566912 00000100:00100000:2.0:1790778854.170604:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510566912 00000100:00100000:2.0:1790778854.170713:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:2.0:1790778854.170727:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:7937:x1877767510566912:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790778854.170753:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778854.170783:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb39 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778854.170826:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778854.170840:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 13 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778854.170880:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4ca00, rc 0) 00000100:00100000:2.0:1790778854.170998:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7937:x1877767510566912:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 275us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778854.171007:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:3.0:1790778854.179278:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778854.179540:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567040 00000100:00100000:0.0:1790778854.179555:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567040 00000100:00100000:0.0:1790778854.179644:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:0.0:1790778854.179657:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7937:x1877767510567040:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790778854.179942:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7937:x1877767510567040:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 286us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778854.179952:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:3.0:1790778854.184102:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778854.184299:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567168 00000100:00100000:1.0:1790778854.184315:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567168 00000100:00100000:1.0:1790778854.184397:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:1.0:1790778854.184410:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7937:x1877767510567168:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790778854.184705:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7937:x1877767510567168:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 297us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778854.184716:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:3.0:1790778854.189771:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778854.190077:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567296 00000100:00100000:0.0:1790778854.190092:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567296 00000100:00100000:0.0:1790778854.190174:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:0.0:1790778854.190186:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7943:x1877767510567296:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778854.190516:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7943:x1877767510567296:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 259us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778854.190527:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:3.0:1790778854.196648:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778854.196966:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567424 00000100:00100000:2.0:1790778854.196983:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567424 00000100:00100000:2.0:1790778854.197093:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:2.0:1790778854.197114:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7943:x1877767510567424:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790778854.197545:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:7943:x1877767510567424:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 432us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778854.197555:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:1.0:1790778854.208463:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778854.208607:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567936 00000100:00100000:0.0:1790778854.208622:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567936 00000100:00100000:0.0:1790778854.208732:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:0.0:1790778854.208746:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510567936:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778854.209070:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510567936:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 326us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778854.209080:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00080000:1.0:1790778854.210962:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778854.216153:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778854.217277:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567552 00000100:00100000:3.0:1790778854.217299:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567552 00000100:00100000:3.0:1790778854.217378:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1790778854.217393:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2342:x1877767510567552:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790778854.217496:0:5949:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4dac8e38-11f9-42ba-9bac-432079f13049@192.168.202.2@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1790778854.217555:0:5949:0:(genops.c:1384:class_connect()) connect: client 4dac8e38-11f9-42ba-9bac-432079f13049, cookie 0xdc8763265607493e 00000004:00100000:3.0:1790778854.217593:0:5949:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790778854.217768:0:5949:0:(import.c:65:import_set_state_nolock()) ffff9ef2365b9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778854.217891:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:2342:x1877767510567552:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 501us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778854.217901:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1790778854.224172:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778854.224377:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567808 00000100:00100000:2.0:1790778854.224396:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567808 00000100:00100000:2.0:1790778854.224551:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790778854.224566:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+6:7937:x1877767510567808:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790778854.224639:0:7119:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1790778854.225512:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+6:7937:x1877767510567808:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 945us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778854.225526:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:1.0:1790778854.225652:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778854.227687:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778854.227811:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510567680 00000100:00100000:3.0:1790778854.227829:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510567680 00000100:00100000:3.0:1790778854.227917:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790778854.227930:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:0:x1877767510567680:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790778854.227980:0:5949:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1790778854.228098:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:0:x1877767510567680:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 169us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778854.228115:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790778854.237229:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778854.237514:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568064 00000100:00100000:0.0:1790778854.237529:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568064 00000100:00100000:0.0:1790778854.237609:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1790778854.237624:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+6:7937:x1877767510568064:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790778854.237754:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+6:7937:x1877767510568064:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 133us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778854.237763:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1790778854.244669:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778854.244716:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778854.244765:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778854.245065:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568192 00000100:00100000:3.0:1790778854.245078:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568192 00000100:00100000:3.0:1790778854.245132:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568320 00000100:00100000:3.0:1790778854.245135:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568320 00000100:00100000:3.0:1790778854.245149:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790778854.245158:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1877767510568192:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790778854.245198:0:6934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4dac8e38-11f9-42ba-9bac-432079f13049@192.168.202.2@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1790778854.245237:0:6934:0:(genops.c:1384:class_connect()) connect: client 4dac8e38-11f9-42ba-9bac-432079f13049, cookie 0xdc87632656074945 00002000:00100000:3.0:1790778854.245253:0:6934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4dac8e38-11f9-42ba-9bac-432079f13049/ffff9ef2365be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778854.245273:0:6934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778854.245366:0:6934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790778854.245402:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef2365bf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778854.245548:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:2342:x1877767510568192:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 390us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778854.245557:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790778854.245576:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1790778854.245581:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1877767510568320:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790778854.245596:0:6934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4dac8e38-11f9-42ba-9bac-432079f13049@192.168.202.2@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1790778854.245627:0:6934:0:(genops.c:1384:class_connect()) connect: client 4dac8e38-11f9-42ba-9bac-432079f13049, cookie 0xdc8763265607494c 00002000:00100000:3.0:1790778854.245633:0:6934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4dac8e38-11f9-42ba-9bac-432079f13049/ffff9ef2365bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778854.245646:0:6934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778854.245689:0:6934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790778854.245706:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef2365ba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778854.245727:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:2342:x1877767510568320:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 145us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778854.245734:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1790778854.246802:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568448 00000100:00100000:0.0:1790778854.246817:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568448 00000100:00100000:0.0:1790778854.247122:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1790778854.247134:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:7937:x1877767510568448:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790778854.247247:0:5952:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790778854.247348:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:7937:x1877767510568448:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 216us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778854.247356:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00010000:00010000:1.0:1790778855.179664:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778855.436160:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531572352:0@lo:400:kworker.0 00000100:00100000:0.0:1790778855.436279:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778855.436370:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778855.436387:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531572224:0@lo:400:kworker.0 00000100:00100000:0.0:1790778855.436422:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778855.436631:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531572096:0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.436688:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778855.436716:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531572608:0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.436743:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778855.436766:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790778855.436772:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531571968:0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.436811:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778855.436841:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531572480:0@lo:400:kworker.0 00000100:00100000:1.0:1790778855.437298:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531571968 00000100:00100000:1.0:1790778855.437313:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531571968 00000100:00100000:1.0:1790778855.437380:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1790778855.437393:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531571968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.437702:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778855.437763:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572352 00000100:00100000:3.0:1790778855.437769:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572352 00000100:00100000:3.0:1790778855.437825:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572608 00000100:00100000:3.0:1790778855.437829:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572608 00000100:00100000:3.0:1790778855.437852:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790778855.437971:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572224 00000100:00100000:0.0:1790778855.437977:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572224 00000100:00100000:0.0:1790778855.438014:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572096 00000100:00100000:0.0:1790778855.438018:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572096 00000100:00100000:0.0:1790778855.438033:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572480 00000100:00100000:0.0:1790778855.438036:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572480 00000100:00100000:0.0:1790778855.438052:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790778855.438060:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531572224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778855.438139:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531572224:12345-0@lo:400:kworker.0 Request processed in 79us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778855.438149:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790778855.438176:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790778855.438183:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531572096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778855.438218:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531572096:12345-0@lo:400:kworker.0 Request processed in 36us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778855.438224:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790778855.438235:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790778855.438241:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531572480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778855.438270:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531572480:12345-0@lo:400:kworker.0 Request processed in 29us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778855.438276:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790778855.438333:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531572224:0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.438392:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531572352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.438607:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531572352:12345-0@lo:400:kworker.0 Request processed in 747us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778855.438616:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778855.438635:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790778855.438643:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531572608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.438677:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531572608:12345-0@lo:400:kworker.0 Request processed in 35us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778855.438701:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790778855.438735:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778855.438741:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778855.438743:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778855.438772:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531572480:0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.438786:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531572096:0@lo:400:kworker.0 00010000:00080000:3.0:1790778855.438802:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236399500 x1877767531572608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778855.438815:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531572608:0@lo:400:kworker.0 00000100:00100000:1.0:1790778855.440235:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531571968:12345-0@lo:400:kworker.0 Request processed in 2833us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778855.440253:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:0.0:1790778855.440502:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef23639aa00 x1877767531572352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778855.440549:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531572352:0@lo:400:kworker.0 00000100:00100000:3.0:1790778855.443791:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531571968:0@lo:400:kworker.0 00010000:00010000:1.0:1790778856.203684:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778857.229334:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778857.488497:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531572864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778857.488607:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778857.488694:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778857.488702:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531572736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778857.488730:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778857.488788:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572864 00000100:00100000:1.0:1790778857.488798:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572864 00000100:00100000:1.0:1790778857.488904:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572736 00000100:00100000:1.0:1790778857.488907:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572736 00000100:00100000:1.0:1790778857.488933:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790778857.488943:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531572864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790778857.489013:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778857.489079:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531572864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778857.489088:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790778857.489112:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778857.489119:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531572736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778857.489168:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778857.489202:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531572736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778857.489211:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790778857.489255:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333df800 x1877767531572736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778857.489279:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531572736:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790778857.489293:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236614000 x1877767531572864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778857.489305:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531572864:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790778857.491948:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778857.491979:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790778858.254282:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778859.275918:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778859.343991:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778859.344096:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778859.344137:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778859.344189:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778859.344291:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568576 00000100:00100000:1.0:1790778859.344307:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568576 00000100:00100000:1.0:1790778859.344386:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:1.0:1790778859.344398:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510568576:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778859.344550:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510568576:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 153us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778859.344559:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:3.0:1790778859.344952:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568960 00000100:00100000:3.0:1790778859.344960:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568960 00000100:00100000:3.0:1790778859.345027:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1790778859.345036:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:2346:x1877767510568960:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778859.345087:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:2346:x1877767510568960:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 53us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778859.345094:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00080000:1.0:1790778859.345256:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778859.345852:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568704 00000100:00100000:0.0:1790778859.345862:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568704 00000100:00100000:0.0:1790778859.345966:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510568832 00000100:00100000:0.0:1790778859.345971:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510568832 00000100:00100000:2.0:1790778859.346021:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1790778859.346033:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510568704:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778859.346099:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510568704:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 68us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778859.346107:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1790778859.346197:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778859.346330:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569088 00000100:00100000:2.0:1790778859.346335:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569088 00000100:00080000:1.0:1790778859.346540:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778859.346546:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778859.347211:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1790778859.347223:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+6:2346:x1877767510568832:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778859.347338:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+6:2346:x1877767510568832:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 116us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778859.347348:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1790778859.348107:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:2.0:1790778859.348120:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dac8e38-11f9-42ba-9bac-432079f13049+6:2346:x1877767510569088:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778859.348616:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dac8e38-11f9-42ba-9bac-432079f13049+6:2346:x1877767510569088:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 498us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778859.348625:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000001:00100000:1.0:1790778860.051725:0:5927:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4dac8e38-11f9-42ba-9bac-432079f13049 00000001:00100000:3.0:1790778860.052314:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4dac8e38-11f9-42ba-9bac-432079f13049 00000001:00100000:1.0:1790778860.052573:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4dac8e38-11f9-42ba-9bac-432079f13049 00010000:00010000:3.0:1790778860.299738:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778860.556837:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531573376:0@lo:400:kworker.0 00000100:00100000:1.0:1790778860.556971:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778860.557066:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778860.557073:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531573248:0@lo:400:kworker.0 00000100:00100000:1.0:1790778860.557101:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778860.557135:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573376 00000100:00100000:1.0:1790778860.557145:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573376 00000100:00100000:1.0:1790778860.557224:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790778860.557235:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531573376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778860.557298:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531573376:12345-0@lo:400:kworker.0 Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778860.557306:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790778860.557331:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790778860.557366:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d76300 x1877767531573376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778860.557383:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531573376:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557497:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531572992:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557538:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778860.557575:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531573504:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557600:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778860.557623:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790778860.557630:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531573120:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557653:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778860.557670:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531573632:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557690:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778860.557718:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573248 00000100:00100000:2.0:1790778860.557722:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573248 00000100:00100000:2.0:1790778860.557760:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573504 00000100:00100000:2.0:1790778860.557775:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573504 00000100:00100000:2.0:1790778860.557791:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573120 00000100:00100000:2.0:1790778860.557793:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573120 00000100:00100000:2.0:1790778860.557806:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790778860.557814:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531573248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557857:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531573248:12345-0@lo:400:kworker.0 Request processed in 44us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778860.557864:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790778860.557876:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790778860.557883:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531573504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557915:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531573504:12345-0@lo:400:kworker.0 Request processed in 33us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778860.557922:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790778860.557932:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790778860.557938:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531573120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.557965:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531573120:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778860.557971:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790778860.557992:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573632 00000100:00100000:2.0:1790778860.557995:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573632 00000100:00100000:2.0:1790778860.558019:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790778860.558026:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531573632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.558056:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531573632:12345-0@lo:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778860.558062:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790778860.558078:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778860.558081:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778860.558111:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531573120:0@lo:400:kworker.0 00010000:00080000:2.0:1790778860.558121:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d74380 x1877767531573632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778860.558131:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531573632:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.558139:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531573504:0@lo:400:kworker.0 00000100:00100000:2.0:1790778860.558172:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531573248:0@lo:400:kworker.0 00000100:00100000:1.0:1790778860.559320:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531572992 00000100:00100000:1.0:1790778860.559333:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531572992 00000100:00100000:1.0:1790778860.559473:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790778860.559483:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531572992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778860.559570:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531572992:12345-0@lo:400:kworker.0 Request processed in 89us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778860.559578:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790778860.559674:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531572992:0@lo:400:kworker.0 00000001:02000400:1.0:1790778860.798874:0:10669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1790778861.324542:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778862.347791:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778862.604090:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531573760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778862.604171:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778862.604299:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531573888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778862.604329:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778862.609250:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573760 00000100:00100000:3.0:1790778862.609266:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573760 00000100:00100000:3.0:1790778862.609335:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531573888 00000100:00100000:3.0:1790778862.609353:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531573888 00000100:00100000:3.0:1790778862.609376:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778862.609386:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531573760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778862.609430:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778862.609538:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531573760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (5366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778862.609546:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790778862.609565:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790778862.609573:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531573888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778862.609588:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778862.609618:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531573888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (5288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778862.609624:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1790778862.615512:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778862.615524:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778862.626958:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef23639aa00 x1877767531573760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778862.626986:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531573760:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790778862.627183:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236612a00 x1877767531573888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778862.627198:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531573888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790778863.372590:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778864.401626:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778864.473176:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778864.473246:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569216 00000100:00100000:2.0:1790778864.473256:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569216 00000100:00100000:2.0:1790778864.473326:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:2.0:1790778864.473338:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510569216:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778864.473427:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510569216:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778864.473435:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:2.0:1790778864.481543:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778864.481582:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778864.481606:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778864.481681:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778864.481709:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569344 00000100:00100000:2.0:1790778864.481719:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569344 00000100:00100000:2.0:1790778864.481775:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569472 00000100:00100000:2.0:1790778864.481779:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569472 00000100:00100000:2.0:1790778864.481802:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:2.0:1790778864.481811:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510569344:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778864.481888:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510569344:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778864.481895:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:2.0:1790778864.481911:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1790778864.481918:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510569472:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778864.481943:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510569472:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778864.481949:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1790778864.481970:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569600 00000100:00100000:2.0:1790778864.481974:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569600 00000100:00100000:2.0:1790778864.481998:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569728 00000100:00100000:2.0:1790778864.482001:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569728 00000100:00100000:2.0:1790778864.482014:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1790778864.482020:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510569600:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778864.482046:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510569600:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778864.482051:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1790778864.482062:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1790778864.482076:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510569728:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778864.482100:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510569728:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778864.482105:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00080000:2.0:1790778864.482126:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778864.482130:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778864.482132:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790778865.423818:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778865.677917:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531574272:0@lo:400:kworker.0 00000100:00100000:1.0:1790778865.678108:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531574144:0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.678167:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778865.678250:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778865.678256:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531574400:0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.678282:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778865.678389:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574400 00000100:00100000:2.0:1790778865.678400:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574400 00000100:00100000:2.0:1790778865.678486:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790778865.678497:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531574400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.678557:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531574400:12345-0@lo:400:kworker.0 Request processed in 61us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778865.678564:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1790778865.678586:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778865.678601:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778865.678623:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531574656:0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.678644:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778865.678662:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790778865.678668:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531574016:0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.678699:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778865.678735:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531574528:0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.678758:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778865.678796:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574272 00000100:00100000:2.0:1790778865.678800:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574272 00000100:00100000:2.0:1790778865.678828:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574144 00000100:00100000:2.0:1790778865.678832:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574144 00000100:00100000:2.0:1790778865.678843:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574528 00000100:00100000:2.0:1790778865.678845:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574528 00000100:00100000:2.0:1790778865.678858:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790778865.678863:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531574272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778865.678988:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790778865.679003:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531574144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778865.679535:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531574144:12345-0@lo:400:kworker.0 Request processed in 532us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778865.679543:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790778865.679563:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790778865.679569:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531574528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778865.679601:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531574528:12345-0@lo:400:kworker.0 Request processed in 33us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778865.679607:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790778865.680150:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531574528:0@lo:400:kworker.0 00000100:00100000:0.0:1790778865.680164:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531574144:0@lo:400:kworker.0 00000100:00100000:0.0:1790778865.680530:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574016 00000100:00100000:0.0:1790778865.680539:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574016 00000100:00100000:0.0:1790778865.680589:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790778865.680597:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531574016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778865.680664:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531574016:12345-0@lo:400:kworker.0 Request processed in 67us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778865.680690:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790778865.680734:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574656 00000100:00100000:0.0:1790778865.680739:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574656 00000100:00100000:0.0:1790778865.680772:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790778865.680780:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531574656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778865.680816:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531574656:12345-0@lo:400:kworker.0 Request processed in 37us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778865.680822:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1790778865.680838:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790778865.680843:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778865.680860:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531574016:0@lo:400:kworker.0 00010000:00080000:0.0:1790778865.680874:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365c9f80 x1877767531574656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778865.680885:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531574656:0@lo:400:kworker.0 00010000:00080000:0.0:1790778865.680938:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236617800 x1877767531574400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778865.680948:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531574400:0@lo:400:kworker.0 00000100:00100000:2.0:1790778865.684221:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531574272:12345-0@lo:400:kworker.0 Request processed in 5346us (6218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778865.684239:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790778865.684386:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531574272:0@lo:400:kworker.0 00010000:00010000:3.0:1790778866.445644:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790778867.101661:0:10931:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790778867.101879:0:10931:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790778867.470628:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778867.724806:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778867.724830:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531574784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778867.724907:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778867.725033:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574784 00000100:00100000:3.0:1790778867.725043:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574784 00000100:00100000:3.0:1790778867.725118:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790778867.725129:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531574784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778867.725178:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778867.725238:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531574784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778867.725246:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1790778867.725293:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef23639aa00 x1877767531574784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778867.725329:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531574784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790778867.725470:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778867.725920:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531574912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778867.725955:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778867.726153:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531574912 00000100:00100000:2.0:1790778867.726168:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531574912 00000100:00100000:2.0:1790778867.726222:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790778867.726231:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531574912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778867.726258:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1790778867.726503:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778867.728349:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531574912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2106us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778867.728379:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1790778867.729364:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d76300 x1877767531574912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778867.729403:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531574912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790778868.492635:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790778868.930332:0:11028:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790778868.930610:0:11028:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790778869.517483:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778869.583375:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778869.583415:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778869.583439:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778869.583488:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569984 00000100:00100000:1.0:1790778869.583499:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569984 00000100:00100000:1.0:1790778869.583571:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1790778869.583582:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510569984:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:3.0:1790778869.583625:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778869.583664:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510569984:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778869.583673:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1790778869.583701:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570112 00000100:00100000:1.0:1790778869.583705:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570112 00000100:00100000:0.0:1790778869.583772:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510569856 00000100:00100000:2.0:1790778869.583776:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778869.583777:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510569856 00000100:00100000:2.0:1790778869.583810:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778869.583828:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570368 00000100:00100000:2.0:1790778869.583832:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570368 00000100:00100000:0.0:1790778869.583853:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:0.0:1790778869.583860:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510569856:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778869.583862:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570240 00000100:00100000:2.0:1790778869.583864:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570240 00000100:00100000:2.0:1790778869.583878:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1790778869.583884:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510570368:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778869.583893:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510569856:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 34us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778869.583899:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:2.0:1790778869.583907:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510570368:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778869.583913:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1790778869.583924:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1790778869.583930:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510570240:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778869.584037:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510570240:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 105us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778869.584044:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:3.0:1790778869.585036:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1790778869.585049:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510570112:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778869.585091:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510570112:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 46us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778869.585097:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00080000:1.0:1790778869.585817:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790778869.585824:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778869.585827:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790778870.539742:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778870.796647:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531575296:0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.796813:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531575168:0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.796890:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778870.796977:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531575680:0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.797009:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778870.797051:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790778870.797058:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531575040:0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.797094:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778870.797119:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531575552:0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.797141:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778870.797177:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575168 00000100:00100000:0.0:1790778870.797187:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575168 00000100:00100000:0.0:1790778870.797260:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575552 00000100:00100000:0.0:1790778870.797264:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575552 00000100:00100000:0.0:1790778870.797300:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790778870.797309:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531575168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.797386:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531575168:12345-0@lo:400:kworker.0 Request processed in 77us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778870.797394:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790778870.797418:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790778870.797424:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531575552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.797506:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531575552:12345-0@lo:400:kworker.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778870.797513:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790778870.797537:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575680 00000100:00100000:0.0:1790778870.797542:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575680 00000100:00100000:0.0:1790778870.797574:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778870.797580:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531575680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778870.797617:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531575680:12345-0@lo:400:kworker.0 Request processed in 37us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778870.797624:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778870.797645:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575040 00000100:00100000:0.0:1790778870.797648:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575040 00000100:00100000:0.0:1790778870.797675:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790778870.797681:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531575040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778870.797833:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778870.797864:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778870.797872:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531575424:0@lo:400:kworker.0 00000100:00100000:3.0:1790778870.797903:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778870.797954:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575424 00000100:00100000:3.0:1790778870.797958:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575424 00000100:00100000:3.0:1790778870.797985:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790778870.797991:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531575424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778870.798025:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531575424:12345-0@lo:400:kworker.0 Request processed in 34us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778870.798031:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1790778870.798265:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333de300 x1877767531575424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778870.798294:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531575424:0@lo:400:kworker.0 00000100:00100000:2.0:1790778870.801295:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575296 00000100:00100000:2.0:1790778870.801315:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575296 00000100:00100000:2.0:1790778870.801395:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790778870.801407:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531575296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778870.801590:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531575296:12345-0@lo:400:kworker.0 Request processed in 184us (3756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778870.801598:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1790778870.801629:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778870.801635:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778870.801638:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778870.801833:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531575040:12345-0@lo:400:kworker.0 Request processed in 33us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778870.801847:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790778870.803045:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531575040:0@lo:400:kworker.0 00000100:00100000:2.0:1790778870.803089:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531575552:0@lo:400:kworker.0 00000100:00100000:2.0:1790778870.803105:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531575168:0@lo:400:kworker.0 00010000:00080000:2.0:1790778870.803141:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333dd880 x1877767531575680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778870.803155:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531575680:0@lo:400:kworker.0 00000100:00100000:3.0:1790778870.803857:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531575296:0@lo:400:kworker.0 00000020:00000004:1.0:1790778870.939236:0:11126:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790778870.939686:0:11126:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790778871.571147:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778872.587914:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790778872.844232:0:11223:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:0.0:1790778872.844875:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778872.844898:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531575808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778872.844974:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778872.845054:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575808 00000100:00100000:0.0:1790778872.845063:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575808 00000100:00100000:0.0:1790778872.845128:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790778872.845140:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531575808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790778872.845167:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778872.845218:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531575808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778872.845236:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1790778872.845262:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778872.845294:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef23639a680 x1877767531575808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778872.845323:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531575808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778872.845630:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778872.845641:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531575936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778872.845677:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778872.845789:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531575936 00000100:00100000:2.0:1790778872.845795:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531575936 00000100:00100000:2.0:1790778872.845838:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790778872.845846:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531575936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778872.845863:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778872.845897:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531575936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778872.845904:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790778872.845966:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365caa00 x1877767531575936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778872.845978:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531575936:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790778872.846029:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:0.0:1790778872.846821:0:11223:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790778873.619842:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778874.635803:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778874.707778:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778874.707830:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778874.707866:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778874.707891:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778874.707932:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570880 00000100:00100000:3.0:1790778874.707943:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570880 00000100:00100000:3.0:1790778874.708003:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571008 00000100:00100000:3.0:1790778874.708007:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571008 00000100:00100000:3.0:1790778874.708027:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790778874.708038:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2342:x1877767510570880:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:3.0:1790778874.708069:0:6935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074945 00000100:00080000:3.0:1790778874.708079:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef2365bf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790778874.708121:0:6935:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790778874.708309:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4dac8e38-11f9-42ba-9bac-432079f13049+2:2342:x1877767510570880:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 272us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778874.708317:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790778874.708351:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1790778874.708359:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2342:x1877767510571008:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:3.0:1790778874.708371:0:6935:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607494c 00000100:00080000:3.0:1790778874.708377:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef2365ba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790778874.708402:0:6935:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790778874.708507:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4dac8e38-11f9-42ba-9bac-432079f13049+2:2342:x1877767510571008:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 148us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778874.708515:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00080000:3.0:1790778874.708534:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778874.708539:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790778874.708549:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778874.709009:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778874.709260:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570624 00000100:00100000:1.0:1790778874.709267:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570624 00000100:00100000:1.0:1790778874.709345:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1790778874.709354:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510570624:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778874.709403:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510570624:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 50us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778874.709411:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00080000:3.0:1790778874.709522:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778874.712551:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570496 00000100:00100000:1.0:1790778874.712570:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570496 00000100:00100000:1.0:1790778874.712647:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:1.0:1790778874.712658:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510570496:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778874.712748:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510570496:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 92us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778874.712756:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:1.0:1790778874.713646:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778874.714000:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510570752 00000100:00100000:3.0:1790778874.714008:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510570752 00000100:00100000:3.0:1790778874.714071:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1790778874.714081:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510570752:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778874.714132:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510570752:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 52us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778874.714139:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00080000:1.0:1790778874.716517:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790778875.660139:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778875.916703:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778875.916848:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778875.916918:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531576192:0@lo:400:kworker.0 00000100:00100000:0.0:1790778875.917002:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778875.917096:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576192 00000100:00100000:0.0:1790778875.917105:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576192 00000100:00100000:0.0:1790778875.917157:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790778875.917168:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531576192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778875.917223:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531576192:12345-0@lo:400:kworker.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778875.917231:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790778875.917287:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531576192:0@lo:400:kworker.0 00000100:00100000:1.0:1790778875.920202:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531576064:0@lo:400:kworker.0 00000100:00100000:1.0:1790778875.920308:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778875.920473:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576064 00000100:00100000:1.0:1790778875.920482:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576064 00000100:00100000:1.0:1790778875.920576:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1790778875.920587:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531576064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778875.920643:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531576064:12345-0@lo:400:kworker.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778875.920651:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1790778875.920717:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531576064:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.920942:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531576320:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.920981:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778875.921008:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778875.921014:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531576448:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921058:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778875.921091:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576320 00000100:00100000:3.0:1790778875.921096:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576320 00000100:00100000:3.0:1790778875.921150:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790778875.921158:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531576320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921195:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531576320:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778875.921201:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790778875.921219:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576448 00000100:00100000:3.0:1790778875.921223:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576448 00000100:00100000:3.0:1790778875.921246:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790778875.921253:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531576448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921298:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531576448:12345-0@lo:400:kworker.0 Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778875.921305:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1790778875.921320:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778875.921324:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790778875.921345:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333ddc00 x1877767531576448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778875.921357:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531576448:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921368:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531576320:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921389:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531576576:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921413:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778875.921432:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778875.921438:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531576704:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921484:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778875.921507:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576704 00000100:00100000:3.0:1790778875.921511:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576704 00000100:00100000:3.0:1790778875.921537:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790778875.921551:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531576704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.921587:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531576704:12345-0@lo:400:kworker.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778875.921594:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1790778875.921607:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778875.921616:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576576 00000100:00100000:3.0:1790778875.921620:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576576 00000100:00100000:3.0:1790778875.921645:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790778875.921651:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531576576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.923600:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531576576:12345-0@lo:400:kworker.0 Request processed in 1939us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778875.923613:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1790778875.923654:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790778875.923776:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333dca80 x1877767531576704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778875.923792:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531576704:0@lo:400:kworker.0 00000100:00100000:3.0:1790778875.923806:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531576576:0@lo:400:kworker.0 00010000:00010000:3.0:1790778876.685253:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790778876.771797:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790778877.707702:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778877.963678:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778877.963710:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531576832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778877.963794:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778877.963880:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576832 00000100:00100000:3.0:1790778877.963888:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576832 00000100:00100000:3.0:1790778877.963955:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790778877.963965:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531576832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778877.964007:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778877.964062:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531576832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778877.964070:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1790778877.964110:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333dd500 x1877767531576832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778877.964129:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531576832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790778877.964341:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778877.967760:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531576960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778877.967838:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778877.967941:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531576960 00000100:00100000:1.0:1790778877.967950:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531576960 00000100:00100000:1.0:1790778877.968005:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790778877.968014:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531576960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790778877.968054:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:2.0:1790778877.968243:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778877.968351:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531576960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778877.968360:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790778877.968426:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365c9c00 x1877767531576960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778877.968507:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531576960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790778878.731751:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778879.763903:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778879.848702:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778879.848754:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778879.848828:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778879.848858:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571264 00000100:00100000:3.0:1790778879.848867:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571264 00000100:00100000:3.0:1790778879.848928:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571392 00000100:00100000:3.0:1790778879.848932:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571392 00000100:00100000:3.0:1790778879.848960:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1790778879.848972:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510571264:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778879.849054:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510571264:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778879.849063:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1790778879.849095:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:3.0:1790778879.849102:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2343:x1877767510571392:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778879.849131:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2343:x1877767510571392:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778879.849137:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00080000:3.0:1790778879.849156:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778879.849295:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571136 00000100:00100000:2.0:1790778879.849300:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571136 00000100:00100000:2.0:1790778879.849337:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 228 00000100:00100000:2.0:1790778879.849344:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510571136:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778879.849379:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510571136:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778879.849386:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 228 00000001:00100000:1.0:1790778880.027220:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4dac8e38-11f9-42ba-9bac-432079f13049 00000020:00000080:1.0:1790778880.027243:0:6930:0:(genops.c:885:class_export_put()) final put ffff9ef2365be000/4dac8e38-11f9-42ba-9bac-432079f13049 00000001:00100000:3.0:1790778880.029554:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4dac8e38-11f9-42ba-9bac-432079f13049 00000020:00000080:3.0:1790778880.029564:0:8008:0:(genops.c:885:class_export_put()) final put ffff9ef2365bd000/4dac8e38-11f9-42ba-9bac-432079f13049 00000020:00000080:1.0:1790778880.036090:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2365be000/4dac8e38-11f9-42ba-9bac-432079f13049 for lustre-OST0000 00000020:00000080:1.0:1790778880.036279:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2365bd000/4dac8e38-11f9-42ba-9bac-432079f13049 for lustre-OST0001 00000020:00000080:1.0:1790778880.036350:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef2365bf000 for lustre-OST0000 00000020:00000080:1.0:1790778880.036365:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef2365ba800 for lustre-OST0001 00010000:00010000:3.0:1790778880.782323:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790778880.790955:0:11515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea2789760 20000000:00000080:2.0:1790778880.790975:0:11515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef2364ce400 uarg=0000000000000000 20000000:01000000:2.0:1790778880.791020:0:11515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790778880.791027:0:11515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790778880.791032:0:11515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790778880.792624:0:11516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790778880.792791:0:11515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790778880.802301:0:11515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790778880.802410:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802431:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802534:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560748ff expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802544:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607490d expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802552:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607491b expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802558:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802565:0:11515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802610:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802694:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 12 pid: 5944 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778880.802711:0:11515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577088:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778880.802901:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607491b expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.802921:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607491b expref: 18 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778880.802930:0:11515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577216:0@lo:104: 00000100:00100000:2.0:1790778880.802975:0:11515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778880.803029:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607490d expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.803038:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607490d expref: 18 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778880.803046:0:11515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577344:0@lo:104: 00000100:00100000:2.0:1790778880.803066:0:11515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778880.803092:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560748ff expref: 18 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.803100:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560748ff expref: 18 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778880.803110:0:11515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577472:0@lo:104: 00000100:00100000:2.0:1790778880.803149:0:11515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790778880.803167:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.803176:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778880.803184:0:11515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577600:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778880.803215:0:11515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790778880.803491:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531577216 00000100:00100000:0.0:1790778880.803500:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531577216 00000100:00100000:0.0:1790778880.803544:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531577344 00000100:00100000:0.0:1790778880.803547:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531577344 00000100:00100000:0.0:1790778880.803557:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531577472 00000100:00100000:0.0:1790778880.803560:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531577472 00000100:00100000:0.0:1790778880.803573:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790778880.803582:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+5:11515:x1877767531577216:12345-0@lo:104: 00010000:00010000:0.0:1790778880.803604:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803683:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790778880.803690:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+5:11515:x1877767531577216:12345-0@lo:104: Request processed in 109us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778880.803697:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790778880.803722:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778880.803729:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:11515:x1877767531577344:12345-0@lo:104: 00010000:00010000:0.0:1790778880.803736:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803774:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790778880.803779:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:11515:x1877767531577344:12345-0@lo:104: Request processed in 53us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778880.803786:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790778880.803797:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790778880.803803:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:11515:x1877767531577472:12345-0@lo:104: 00010000:00010000:0.0:1790778880.803810:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803840:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790778880.803845:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:11515:x1877767531577472:12345-0@lo:104: Request processed in 44us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778880.803851:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1790778880.803868:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790778880.803876:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803890:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387e00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778880.803895:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803905:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778880.803912:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778880.803919:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790778880.803950:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803958:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778880.803980:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.803988:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef236387e00/0xdc8763265607491b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074922 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804002:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790778880.804006:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804012:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386c00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778880.804016:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804033:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778880.804040:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778880.804046:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790778880.804059:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804065:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778880.804071:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804078:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef236386c00/0xdc8763265607490d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074914 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804087:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778880.804090:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804097:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4cc00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778880.804100:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804107:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778880.804114:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778880.804124:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790778880.804136:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804141:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778880.804159:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804166:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc876326560748ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074906 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778880.804180:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778880.804182:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778880.804183:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778880.804197:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531577728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778880.804246:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778880.804270:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778880.804275:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531577856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778880.804294:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778880.804319:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531577984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790778880.805264:0:11515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577216:0@lo:104: 00000100:00100000:2.0:1790778880.805277:0:11515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577344:0@lo:104: 00000100:00100000:2.0:1790778880.805285:0:11515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577472:0@lo:104: 00000100:00100000:2.0:1790778880.805677:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531577728 00000100:00100000:2.0:1790778880.805685:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531577728 00010000:00010000:2.0:1790778880.805720:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607491b expref: 19 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778880.805852:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778880.805892:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531577856 00000100:00100000:2.0:1790778880.805897:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531577856 00010000:00010000:2.0:1790778880.805912:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607490d expref: 20 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778880.806276:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778880.806780:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531577984 00000100:00100000:3.0:1790778880.806787:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531577984 00010000:00010000:3.0:1790778880.806809:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560748ff expref: 21 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778880.806830:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778880.806839:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+21:3439:x1877767531577728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778880.806855:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778880.806860:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607491b expref: 21 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.806872:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607491b expref: 21 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.806891:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236386600/0xdc87632656074922 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607491b expref: 21 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.806906:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778880.806957:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+20:3439:x1877767531577728:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778880.806981:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790778880.807025:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778880.807032:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531577856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778880.807039:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778880.807044:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607490d expref: 19 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.807053:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607490d expref: 19 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.807063:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236387400/0xdc87632656074914 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607490d expref: 19 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.807072:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778880.807094:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+18:3439:x1877767531577856:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778880.807101:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790778880.807112:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778880.807118:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+17:3441:x1877767531577984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778880.807125:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778880.807130:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560748ff expref: 17 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778880.807242:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531577856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778880.807253:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531577728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778880.807292:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560748ff expref: 17 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.807306:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a0600/0xdc87632656074906 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560748ff expref: 17 pid: 5944 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.807326:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778880.807548:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+16:3441:x1877767531577984:12345-0@lo:103:ldlm_bl.0 Request processed in 429us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778880.807555:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790778880.807748:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531577984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790778880.807822:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778880.808863:0:11515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577088:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778880.810277:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778880.810370:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571520 00000100:00100000:1.0:1790778880.810378:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571520 00010000:00010000:1.0:1790778880.810421:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 13 pid: 5944 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778880.810497:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1790778880.810507:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510571520:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778880.810522:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778880.810528:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 13 pid: 5944 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778880.810539:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 13 pid: 5944 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778880.810556:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4ca00/0xdc87632656074937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb39 expref: 13 pid: 5944 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778880.810571:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778880.810804:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:2345:x1877767510571520:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 298us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778880.810814:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1790778880.811769:0:11515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1877767531577600:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778880.811805:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778880.816981:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778880.817067:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571648 00000100:00100000:2.0:1790778880.817078:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571648 00010000:00010000:2.0:1790778880.817119:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778880.817169:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1790778880.817179:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:2346:x1877767510571648:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778880.817212:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778880.817218:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817243:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817261:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a0200/0xdc876326560748f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb01 expref: 12 pid: 5943 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817279:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817289:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817306:0:5933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817314:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817321:0:5933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817328:0:5933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817335:0:5933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778880.817340:0:5933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817358:0:5933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817382:0:5933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778880.817394:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778880.817486:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:2346:x1877767510571648:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 307us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778880.817494:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00010000:00010000:3.0:1790778880.818615:0:11515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.818644:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778880.818650:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4c800/0xdc87632656074953 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778881.036339:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790778881.036372:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531578112:0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.036384:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531578624:0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.042661:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778881.042808:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778881.042823:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531578496:0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.042859:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778881.042893:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531578368:0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.042950:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778881.043025:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778881.043033:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531578240:0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.043059:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778881.043408:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578624 00000100:00100000:2.0:1790778881.043419:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578624 00000100:00100000:2.0:1790778881.043550:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578368 00000100:00100000:2.0:1790778881.043554:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578368 00000100:00100000:2.0:1790778881.043575:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790778881.043586:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531578624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778881.043666:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531578624:12345-0@lo:400:kworker.0 Request processed in 82us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778881.043675:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790778881.043694:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790778881.043700:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531578368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778881.043735:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531578368:12345-0@lo:400:kworker.0 Request processed in 35us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778881.043741:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790778881.043760:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778881.043765:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790778881.043802:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d75500 x1877767531578368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778881.043827:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531578368:0@lo:400:kworker.0 00010000:00080000:2.0:1790778881.043862:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d74000 x1877767531578624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778881.043872:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531578624:0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.043964:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578496 00000100:00100000:1.0:1790778881.043969:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578496 00000100:00100000:1.0:1790778881.044015:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578240 00000100:00100000:1.0:1790778881.044019:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578240 00000100:00100000:1.0:1790778881.044041:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790778881.044048:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531578496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.044090:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531578496:12345-0@lo:400:kworker.0 Request processed in 43us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778881.044097:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790778881.044110:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790778881.044116:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531578240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778881.044237:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531578240:12345-0@lo:400:kworker.0 Request processed in 120us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778881.044244:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1790778881.044324:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778881.044354:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531578240:0@lo:400:kworker.0 00000100:00100000:2.0:1790778881.044380:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531578496:0@lo:400:kworker.0 00000100:00100000:0.0:1790778881.047672:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778881.047795:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578112 00000100:00100000:3.0:1790778881.047805:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578112 00000100:00100000:3.0:1790778881.047935:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790778881.047944:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531578112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778881.048011:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531578112:12345-0@lo:400:kworker.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778881.048018:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790778881.048089:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531578112:0@lo:400:kworker.0 00010000:00010000:1.0:1790778881.821790:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790778882.508647:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790778882.508656:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef235b0c800 from 7 10000000:01000000:3.0:1790778882.508661:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790778882.508723:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.508737:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.508767:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778882.508806:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531578752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790778882.508892:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778882.508955:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bae780 going to sleep for 11 seconds 00000100:00100000:0.0:1790778882.509074:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578752 00000100:00100000:0.0:1790778882.509082:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578752 00000100:00100000:0.0:1790778882.509136:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790778882.509145:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531578752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778882.509161:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778882.509175:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607495a expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778882.509201:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607495a expref: 17 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778882.509222:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607495a expref: 17 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778882.509231:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1400, rc 0) 00000100:00100000:0.0:1790778882.509282:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531578752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778882.509289:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790778882.510591:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531578752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778882.510623:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.510635:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778882.510710:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531578880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778882.510751:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778882.510810:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bae780 going to sleep for 11 seconds 00000100:00100000:0.0:1790778882.510958:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531578880 00000100:00100000:0.0:1790778882.510965:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531578880 00000100:00100000:0.0:1790778882.511013:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790778882.511022:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531578880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778882.511147:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531578880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778882.511154:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790778882.511385:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531578880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778882.511410:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778882.511473:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778882.511487:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205bae780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778882.511544:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579008 00000100:00100000:2.0:1790778882.511549:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579008 00000100:00100000:2.0:1790778882.511572:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1790778882.511579:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531579008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.511655:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531579008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778882.511661:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790778882.512388:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790778882.513752:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790778882.528028:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790778882.528080:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790778882.528095:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.528110:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778882.528293:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790778882.528298:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef2332da000 from 7 10000000:01000000:2.0:1790778882.528301:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790778882.528354:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.528363:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.528374:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778882.528404:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.528500:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778882.528542:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579136 00000100:00100000:2.0:1790778882.528549:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579136 00000100:00100000:2.0:1790778882.528590:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790778882.528598:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531579136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778882.528624:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778882.528636:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074968 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.528659:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074968 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.528670:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074968 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.528678:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c600, rc 0) 00000100:00100000:2.0:1790778882.528712:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531579136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778882.528719:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790778882.528772:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778882.529182:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778882.529199:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.529217:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778882.529280:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.529308:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778882.529337:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778882.529495:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579264 00000100:00100000:1.0:1790778882.529500:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579264 00000100:00100000:1.0:1790778882.529529:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790778882.529536:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531579264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778882.529677:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531579264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778882.529685:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790778882.529967:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.529998:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.530044:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778882.530081:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790778882.530122:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579392 00000100:00100000:1.0:1790778882.530133:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579392 00000100:00100000:1.0:1790778882.530169:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790778882.530177:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531579392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778882.530264:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531579392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778882.530271:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1790778882.531482:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790778882.534766:0:11552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790778882.540514:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790778882.540560:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778882.540572:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778882.540585:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778882.540597:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790778882.540612:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef211145000 from 7 10000000:01000000:1.0:1790778882.540615:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790778882.540651:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778882.540659:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778882.540670:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778882.540696:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790778882.540778:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778882.540853:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21111f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778882.541739:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579520 00000100:00100000:2.0:1790778882.541753:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579520 00000100:00100000:2.0:1790778882.541839:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1790778882.541849:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531579520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778882.541867:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778882.541886:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074976 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.541917:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074976 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.541946:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074976 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778882.541955:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4de00, rc 0) 00000100:00100000:2.0:1790778882.542022:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531579520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778882.542030:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790778882.544179:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778882.544232:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778882.544246:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778882.544332:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778882.544389:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778882.544438:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21111f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778882.544534:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579648 00000100:00100000:2.0:1790778882.544540:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579648 00000100:00100000:2.0:1790778882.544595:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790778882.544614:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531579648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.544769:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531579648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778882.544777:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1790778882.545036:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.545075:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.545123:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778882.545147:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579776 00000100:00100000:2.0:1790778882.545151:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579776 00000100:00100000:2.0:1790778882.545173:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790778882.545179:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531579776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778882.545266:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531579776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778882.545273:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1790778882.545324:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778882.545337:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531579776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790778882.548326:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790778882.550168:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790778882.550219:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790778882.550254:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.550268:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778882.828871:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778882.831558:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778882.835375:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571776 00000100:00100000:3.0:1790778882.835396:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571776 00000100:00100000:3.0:1790778882.835549:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:3.0:1790778882.835561:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:5437:x1877767510571776:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778882.835581:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778882.835602:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb63 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.835641:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.835654:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778882.835663:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201498c00, rc 0) 00000100:00100000:3.0:1790778882.835747:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510571776:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 188us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778882.835756:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:0.0:1790778882.842984:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778882.843081:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510571904 00000100:00100000:1.0:1790778882.843092:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510571904 00000100:00100000:1.0:1790778882.843149:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:1.0:1790778882.843158:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510571904:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778882.843319:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510571904:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 161us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778882.843327:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:1.0:1790778882.849059:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778882.849146:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572032 00000100:00100000:3.0:1790778882.849158:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572032 00000100:00100000:3.0:1790778882.849224:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 240 00000100:00100000:3.0:1790778882.849235:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510572032:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778882.849505:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510572032:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 271us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778882.849513:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 240 00000100:00100000:1.0:1790778882.857147:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778882.857252:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572160 00000100:00100000:0.0:1790778882.857263:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572160 00000100:00100000:0.0:1790778882.857320:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 241 00000100:00100000:0.0:1790778882.857330:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510572160:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778882.857348:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778882.857367:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb6a expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778882.857396:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778882.857408:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 13 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778882.857416:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:0.0:1790778882.857498:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510572160:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778882.857506:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 241 00000100:00100000:0.0:1790778882.862358:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778882.862503:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572288 00000100:00100000:3.0:1790778882.862519:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572288 00000100:00100000:3.0:1790778882.862589:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 242 00000100:00100000:3.0:1790778882.862611:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510572288:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778882.862780:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510572288:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 181us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778882.862788:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 242 00000100:00100000:3.0:1790778882.871770:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778882.871867:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572416 00000100:00100000:1.0:1790778882.871877:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572416 00000100:00100000:1.0:1790778882.871940:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 243 00000100:00100000:1.0:1790778882.871952:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510572416:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778882.872110:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510572416:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 160us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778882.872128:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 243 00000100:00100000:0.0:1790778883.084725:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531579904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778883.084810:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778883.084937:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531579904 00000100:00100000:0.0:1790778883.084946:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531579904 00000100:00100000:0.0:1790778883.085000:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790778883.085009:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531579904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790778883.085039:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778883.085083:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531579904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778883.085097:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1790778883.085120:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790778883.085153:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333df800 x1877767531579904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778883.085171:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531579904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778883.085988:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778883.086028:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778883.086071:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580032 00000100:00100000:2.0:1790778883.086078:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580032 00000100:00100000:2.0:1790778883.086116:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790778883.086123:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531580032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778883.086145:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1790778883.086179:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778883.086181:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531580032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778883.086187:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1790778883.086230:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365c9180 x1877767531580032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778883.086245:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531580032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790778883.857175:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778884.875895:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778884.950375:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778884.950522:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778884.950551:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778884.950585:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572544 00000100:00100000:2.0:1790778884.950597:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572544 00000100:00100000:2.0:1790778884.950661:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 244 00000100:00100000:2.0:1790778884.950672:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510572544:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778884.950777:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510572544:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 90us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778884.950786:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 244 00000100:00100000:2.0:1790778884.950836:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572800 00000100:00100000:2.0:1790778884.950840:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572800 00000100:00100000:2.0:1790778884.950879:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572672 00000100:00100000:2.0:1790778884.950882:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572672 00000100:00100000:2.0:1790778884.950905:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:2.0:1790778884.950913:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510572800:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778884.950945:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510572800:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778884.950951:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:2.0:1790778884.950962:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1790778884.950967:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510572672:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778884.950989:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510572672:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778884.950995:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00080000:2.0:1790778884.951160:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790778885.061828:0:11713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790778885.911331:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778886.157653:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531580416:0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.157751:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778886.157824:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778886.157831:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531580544:0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.157858:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778886.157904:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580416 00000100:00100000:3.0:1790778886.157913:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580416 00000100:00100000:1.0:1790778886.158142:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531580160:0@lo:400:kworker.0 00000100:00100000:1.0:1790778886.158198:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778886.158232:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531580672:0@lo:400:kworker.0 00000100:00100000:1.0:1790778886.158255:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778886.158301:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531580288:0@lo:400:kworker.0 00000100:00080000:2.0:1790778886.158410:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778886.158424:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580544 00000100:00100000:2.0:1790778886.158428:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580544 00000100:00100000:2.0:1790778886.158492:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790778886.158503:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778886.158571:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531580544:12345-0@lo:400:kworker.0 Request processed in 71us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778886.158580:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1790778886.158602:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778886.161159:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580160 00000100:00100000:1.0:1790778886.161187:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580160 00000100:00100000:1.0:1790778886.161341:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790778886.161352:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531580160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778886.161437:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531580160:12345-0@lo:400:kworker.0 Request processed in 87us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778886.161474:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790778886.161525:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531580160:0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.166379:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580672 00000100:00100000:3.0:1790778886.166399:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580672 00010000:00080000:3.0:1790778886.166540:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef205c03480 x1877767531580544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778886.166560:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531580544:0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.169574:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790778886.169596:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531580416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.169747:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531580416:12345-0@lo:400:kworker.0 Request processed in 157us (11996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778886.169757:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790778886.169781:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790778886.169788:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531580672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.169826:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531580672:12345-0@lo:400:kworker.0 Request processed in 39us (11570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778886.169832:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790778886.169885:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531580416:0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.169929:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531580672:0@lo:400:kworker.0 00000100:00100000:3.0:1790778886.169986:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778886.170025:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531580800:0@lo:400:kworker.0 00000100:00100000:2.0:1790778886.170049:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580288 00000100:00100000:3.0:1790778886.170067:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778886.170069:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580288 00000100:00100000:2.0:1790778886.170116:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790778886.170126:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531580288:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790778886.170159:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778886.170191:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531580288:12345-0@lo:400:kworker.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778886.170200:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790778886.170216:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531580288:0@lo:400:kworker.0 00000100:00100000:2.0:1790778886.170255:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580800 00000100:00100000:2.0:1790778886.170260:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580800 00000100:00100000:2.0:1790778886.170311:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790778886.170319:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531580800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778886.170360:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531580800:12345-0@lo:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778886.170367:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1790778886.170401:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2201af800 x1877767531580800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778886.170413:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2201af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531580800:0@lo:400:kworker.0 00000100:00080000:3.0:1790778886.171795:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790778886.923668:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778887.947791:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778888.204839:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778888.204865:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531580928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778888.204949:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778888.205044:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531580928 00000100:00100000:2.0:1790778888.205053:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531580928 00000100:00080000:0.0:1790778888.205097:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778888.205109:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790778888.205118:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531580928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778888.205147:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778888.205304:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531581056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778888.205332:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778888.205396:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581056 00000100:00100000:1.0:1790778888.205402:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581056 00000100:00100000:1.0:1790778888.205428:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790778888.205436:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531581056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778888.205482:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1790778888.205501:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778888.205848:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531581056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 412us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778888.205873:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790778888.206516:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531580928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1397us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778888.206527:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1790778888.207016:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2364e1500 x1877767531581056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778888.207047:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531581056:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790778888.207062:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365c8e00 x1877767531580928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778888.207074:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531580928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790778888.972363:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778890.006555:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778890.069070:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778890.069192:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778890.069328:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510573056 00000100:00100000:0.0:1790778890.069343:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510573056 00000100:00100000:0.0:1790778890.069437:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:0.0:1790778890.069479:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510573056:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778890.069616:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510573056:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 142us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778890.069640:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00080000:3.0:1790778890.070129:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778890.071159:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510572928 00000100:00100000:1.0:1790778890.071173:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510572928 00000100:00100000:1.0:1790778890.071249:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 246 00000100:00100000:1.0:1790778890.071261:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510572928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778890.071349:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510572928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 91us (3920us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778890.071358:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 246 00000100:00100000:3.0:1790778890.080541:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778890.080783:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510573184 00000100:00100000:0.0:1790778890.080798:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510573184 00000100:00100000:0.0:1790778890.080893:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1790778890.080904:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510573184:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778890.081021:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510573184:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 118us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778890.081030:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00080000:3.0:1790778890.082866:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1790778890.940363:0:11862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:34:49 (1790778889) === 00010000:00010000:1.0:1790778891.021560:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778891.157945:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778891.158016:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.158060:0:5958:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510573440 00000100:00100000:0.0:1790778891.158070:0:5958:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510573440 00000100:00100000:0.0:1790778891.158142:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1790778891.158153:0:5958:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b53b344e-0d4c-4209-a606-d24036760c61+6:9586:x1877767510573440:12345-192.168.202.2@tcp:700:mkdir.0 00000100:00100000:0.0:1790778891.158664:0:5958:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b53b344e-0d4c-4209-a606-d24036760c61+6:9586:x1877767510573440:12345-192.168.202.2@tcp:700:mkdir.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778891.158674:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1790778891.165569:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510573312 00000100:00100000:2.0:1790778891.165595:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510573312 00000100:00100000:2.0:1790778891.165706:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1790778891.165720:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2343:x1877767510573312:12345-192.168.202.2@tcp:41:mkdir.0 00000004:00000024:2.0:1790778891.165787:0:7119:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1790778891.165903:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2343:x1877767510573312:12345-192.168.202.2@tcp:41:mkdir.0 Request processed in 188us (7966us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778891.165911:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1790778891.171620:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.172572:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510573696 00000100:00100000:3.0:1790778891.172616:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510573696 00000100:00100000:1.0:1790778891.172738:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1790778891.172758:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:9586:x1877767510573696:12345-192.168.202.2@tcp:36:mkdir.0 00010000:00010000:1.0:1790778891.172836:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778891.172912:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074873 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcaec expref: 6 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.172931:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef215c54b00) 00010000:00010000:1.0:1790778891.172942:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778891.173039:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.173054:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.173064:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.173091:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.173112:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.173119:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778891.174713:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790778891.174729:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.174738:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.174745:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.174751:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778891.174756:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.174837:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.174852:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6800) 00010000:00010000:0.0:1790778891.174855:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778891.174860:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.174867:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074992 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778891.174898:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b72bb906 reply state 00000000450eed3e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778891.174907:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778891.175065:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:9586:x1877767510573696:12345-192.168.202.2@tcp:36:mkdir.0 Request processed in 2312us (3453us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790778891.175074:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:2.0:1790778891.177736:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.178019:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.178027:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.178033:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778891.178039:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.178047:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.178207:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef240eb6b00) 00010000:00010000:2.0:1790778891.178212:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778891.178295:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.178325:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074999 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778891.187798:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.188019:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510573824 00000100:00100000:0.0:1790778891.188031:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510573824 00000100:00100000:0.0:1790778891.188093:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1790778891.188104:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:9587:x1877767510573824:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:0.0:1790778891.188140:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778891.188167:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560749a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb71 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.188246:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.188279:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.188291:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778891.188344:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790778891.188349:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778891.188391:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.188420:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560749a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb71 expref: 8 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.188438:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb71 expref: 7 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.190288:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef203c61100) 00010000:00010000:0.0:1790778891.190292:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778891.190296:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1800, rc 0) 00000100:00100000:0.0:1790778891.190387:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:9587:x1877767510573824:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 2280us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778891.190397:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790778891.194718:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.195043:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510574080 00000100:00100000:0.0:1790778891.195065:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510574080 00000100:00100000:0.0:1790778891.195225:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1790778891.195237:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:9587:x1877767510574080:12345-192.168.202.2@tcp:36:chmod.0 00010000:00010000:0.0:1790778891.195303:0:5950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778891.195352:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb71 expref: 7 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.195377:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef203c61100) 00010000:00010000:0.0:1790778891.195389:0:5950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778891.195419:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.195435:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.195511:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778891.195711:0:5950:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006c0ef3fa reply state 000000001935db9c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778891.195722:0:5950:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790778891.195730:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790778891.195843:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:9587:x1877767510574080:12345-192.168.202.2@tcp:36:chmod.0 Request processed in 608us (1138us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790778891.195851:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00010000:00010000:1.0:1790778891.201985:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.201999:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.202006:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.202011:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.202015:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.202020:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.202032:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:1.0:1790778891.202034:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790778891.202037:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.202041:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560749ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778891.218673:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.218981:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510574208 00000100:00100000:3.0:1790778891.219047:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510574208 00000100:00100000:3.0:1790778891.219177:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1790778891.219191:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:9588:x1877767510574208:12345-192.168.202.2@tcp:101:chown.0 00010000:00010000:3.0:1790778891.219227:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778891.219264:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb78 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.219357:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201498800/0xdc876326560749bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.219376:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201498800/0xdc876326560749bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.219391:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201498800/0xdc876326560749bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778891.219500:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790778891.219505:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778891.219560:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201498800/0xdc876326560749bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.219593:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb78 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.219632:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201498800/0xdc876326560749bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb78 expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.219641:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef23621ab00) 00010000:00010000:3.0:1790778891.219662:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790778891.219667:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef201498800, rc 0) 00000100:00100000:3.0:1790778891.219757:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:9588:x1877767510574208:12345-192.168.202.2@tcp:101:chown.0 Request processed in 569us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778891.219765:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1790778891.223743:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.224074:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510574336 00000100:00100000:1.0:1790778891.224111:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510574336 00000100:00100000:1.0:1790778891.224251:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790778891.224265:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:9588:x1877767510574336:12345-192.168.202.2@tcp:101:chown.0 00010000:00010000:1.0:1790778891.224298:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778891.224330:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc876326560749c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb7f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224420:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224439:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224502:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224535:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224543:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224550:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224647:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560749d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224656:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560749d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224664:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560749d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778891.224728:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790778891.224734:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778891.224776:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560749d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224793:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224802:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224810:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224818:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.224824:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224833:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224857:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef23621ab00) 00010000:00010000:1.0:1790778891.224861:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778891.224867:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224873:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc876326560749ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224887:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224904:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224911:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224916:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.224920:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224927:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224935:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790778891.224938:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778891.224940:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224947:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560749d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.224990:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc876326560749c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb7f expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.225017:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560749d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb7f expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.225025:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:1.0:1790778891.225037:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778891.225045:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386600, rc 0) 00000100:00100000:1.0:1790778891.225146:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:9588:x1877767510574336:12345-192.168.202.2@tcp:101:chown.0 Request processed in 883us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778891.225155:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790778891.228530:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.228890:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510574592 00000100:00100000:0.0:1790778891.228903:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510574592 00000100:00100000:0.0:1790778891.228978:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1790778891.228990:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+9:9588:x1877767510574592:12345-192.168.202.2@tcp:36:chown.0 00010000:00010000:0.0:1790778891.229084:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778891.229117:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560749d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb7f expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.229179:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:0.0:1790778891.229195:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778891.229231:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.229247:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.229259:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778891.239110:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1790778891.239268:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a1e993c7 reply state 000000006efd6771 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778891.239288:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790778891.239307:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1790778891.239720:0:7119:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790778891.239757:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:9588:x1877767510574592:12345-192.168.202.2@tcp:36:chown.0 Request processed in 10762us (11242us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790778891.239769:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:2.0:1790778891.240039:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.240051:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.240061:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.240068:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778891.240074:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.240083:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.240103:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef203c61100) 00010000:00010000:2.0:1790778891.240106:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790778891.240112:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.240119:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc876326560749df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778891.260357:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.261295:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510574720 00000100:00100000:0.0:1790778891.261312:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510574720 00000100:00100000:0.0:1790778891.261404:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1790778891.261417:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:9589:x1877767510574720:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:0.0:1790778891.261503:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778891.261544:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560749e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb86 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790778891.269911:0:5950:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8253us 00000100:00100000:3.0:1790778891.276105:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531581440:0@lo:400:kworker.0 00000100:00100000:3.0:1790778891.276212:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778891.276494:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531581312:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.276671:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531581184:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.276717:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778891.277141:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778891.277192:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581440 00000100:00100000:2.0:1790778891.277203:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581440 00000100:00100000:3.0:1790778891.277234:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778891.277276:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531581568:0@lo:400:kworker.0 00000100:00100000:3.0:1790778891.277361:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778891.277383:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531581696:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.277432:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778891.277484:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581312 00000100:00100000:3.0:1790778891.277495:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581312 00000100:00100000:0.0:1790778891.277535:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581184 00000100:00100000:0.0:1790778891.277541:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581184 00000100:00100000:2.0:1790778891.277702:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581696 00000100:00100000:2.0:1790778891.277707:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581696 00000100:00100000:2.0:1790778891.277729:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790778891.278049:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531581440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778891.278152:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531581440:12345-0@lo:400:kworker.0 Request processed in 413us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778891.278161:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790778891.278185:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790778891.278193:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531581696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778891.278234:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531581696:12345-0@lo:400:kworker.0 Request processed in 43us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778891.278241:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790778891.278271:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790778891.278284:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.278352:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790778891.278364:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531581312:12345-0@lo:400:kworker.0 Request processed in 81us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778891.278368:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531581184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778891.278385:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790778891.278436:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531581184:12345-0@lo:400:kworker.0 Request processed in 74us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778891.278472:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790778891.278492:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581568 00000100:00100000:3.0:1790778891.278499:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581568 00000100:00100000:3.0:1790778891.279271:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790778891.279282:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531581568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778891.279352:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531581568:12345-0@lo:400:kworker.0 Request processed in 70us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778891.279361:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1790778891.279428:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790778891.279432:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236427100 x1877767531581568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790778891.279437:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778891.279482:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531581568:0@lo:400:kworker.0 00000100:00100000:2.0:1790778891.279506:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531581440:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.279919:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531581312:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.279935:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531581824:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.280001:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778891.280071:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581824 00000100:00100000:0.0:1790778891.280078:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581824 00000100:00100000:0.0:1790778891.280152:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790778891.280161:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531581824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.280212:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531581824:12345-0@lo:400:kworker.0 Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778891.280219:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790778891.280241:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790778891.280804:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236425c00 x1877767531581824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778891.280850:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531581824:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.280887:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531581184:0@lo:400:kworker.0 00000100:00100000:0.0:1790778891.280902:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531581696:0@lo:400:kworker.0 00010000:00010000:3.0:1790778891.299424:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.299495:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.299511:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.299546:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.299554:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.299561:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.300946:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560749fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.301143:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560749fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.301157:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560749fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778891.301221:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790778891.301226:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778891.302099:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560749fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302143:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302152:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302161:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302167:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201499a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778891.302174:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302185:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302204:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef23621ab00) 00010000:00010000:3.0:1790778891.302208:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778891.302214:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.302221:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201499a00/0xdc876326560749ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303080:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303094:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303101:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303120:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778891.303134:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303142:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303155:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef23621a600) 00010000:00010000:3.0:1790778891.303158:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778891.303162:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303168:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc876326560749f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303234:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560749e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb86 expref: 8 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303251:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560749fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb86 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.303685:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:3.0:1790778891.303688:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790778891.303691:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790778891.304182:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:9589:x1877767510574720:12345-192.168.202.2@tcp:101:touch.500 Request processed in 42762us (43844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778891.304194:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1790778891.314289:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.314650:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510574976 00000100:00100000:0.0:1790778891.314665:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510574976 00000100:00100000:0.0:1790778891.314735:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1790778891.314763:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:9589:x1877767510574976:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:0.0:1790778891.314793:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778891.314820:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656074a02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb8d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.315435:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.315904:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.315920:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.316143:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.316170:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.316183:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790778891.317944:0:5949:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1790778891.320545:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074a17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320574:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320588:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320630:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320639:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320646:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320652:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778891.320657:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320665:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320678:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:0.0:1790778891.320682:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778891.320687:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320710:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778891.320725:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007388cce3 reply state 000000004e85e020 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778891.320734:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790778891.320770:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656074a02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb8d expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320785:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb8d expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778891.320793:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef203c61c00) 00010000:00010000:0.0:1790778891.320795:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778891.320797:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0a00, rc 0) 00000100:00100000:0.0:1790778891.320879:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+10:9589:x1877767510574976:12345-192.168.202.2@tcp:101:touch.500 Request processed in 6135us (6610us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790778891.320888:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00010000:00010000:3.0:1790778891.340078:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.340099:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.340107:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.340113:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778891.340119:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.340152:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.340173:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3849b3c7 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778891.340176:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778891.340181:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.340186:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074a10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778891.342843:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.343496:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510575232 00000100:00100000:1.0:1790778891.343510:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510575232 00000100:00100000:1.0:1790778891.343598:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:1.0:1790778891.343609:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+9:9589:x1877767510575232:12345-192.168.202.2@tcp:36:touch.500 00010000:00010000:1.0:1790778891.343687:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778891.343721:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074a17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb8d expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.343745:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef203c61c00) 00010000:00010000:1.0:1790778891.343761:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778891.343829:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.343858:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.343869:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778891.344018:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000574908a7 reply state 000000000009e8dd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778891.344029:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790778891.344162:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+10:9589:x1877767510575232:12345-192.168.202.2@tcp:36:touch.500 Request processed in 555us (1332us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790778891.344187:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00010000:00010000:1.0:1790778891.346723:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.346746:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.346766:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.346773:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.346780:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.346789:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.346818:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778891.346821:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778891.346828:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.346842:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074a25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778891.348336:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.348583:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510575360 00000100:00100000:1.0:1790778891.348597:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510575360 00000100:00100000:1.0:1790778891.348663:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1790778891.348674:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:9589:x1877767510575360:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:1.0:1790778891.348706:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778891.348751:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656074a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb94 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.348856:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656074a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb94 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.348873:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656074a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb94 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.348896:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef215c54400) 00010000:00010000:1.0:1790778891.348899:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790778891.348904:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386000, rc 0) 00000100:00100000:1.0:1790778891.348982:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+10:9589:x1877767510575360:12345-192.168.202.2@tcp:101:touch.500 Request processed in 310us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778891.349001:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1790778891.352612:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.352780:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510575488 00000100:00100000:3.0:1790778891.352794:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510575488 00000100:00100000:3.0:1790778891.352856:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790778891.352866:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2342:x1877767510575488:12345-192.168.202.2@tcp:8:touch.500 00010000:00080000:3.0:1790778891.352910:0:6935:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:3.0:1790778891.352950:0:6935:0:(genops.c:1384:class_connect()) connect: client b53b344e-0d4c-4209-a606-d24036760c61, cookie 0xdc87632656074a33 00002000:00100000:3.0:1790778891.353090:0:6935:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b53b344e-0d4c-4209-a606-d24036760c61/ffff9ef2365bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778891.353142:0:6935:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778891.353250:0:6935:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790778891.353365:0:6935:0:(import.c:65:import_set_state_nolock()) ffff9ef2365ba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778891.353542:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2342:x1877767510575488:12345-192.168.202.2@tcp:8:touch.500 Request processed in 675us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778891.353552:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1790778891.365063:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778891.365898:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510575616 00000100:00100000:2.0:1790778891.365914:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510575616 00000100:00100000:2.0:1790778891.366026:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1790778891.366038:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:0:x1877767510575616:12345-192.168.202.2@tcp:2:touch.500 00000100:00080000:0.0:1790778891.366712:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790778891.370948:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1790778891.370968:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000100:00100000:2.0:1790778891.371622:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:0:x1877767510575616:12345-192.168.202.2@tcp:2:touch.500 Request processed in 5574us (6566us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790778891.371642:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1790778891.379227:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.380039:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510575872 00000100:00100000:1.0:1790778891.380057:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510575872 00000100:00100000:1.0:1790778891.380161:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1790778891.380174:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+10:9589:x1877767510575872:12345-192.168.202.2@tcp:35:touch.500 00000100:00100000:1.0:1790778891.380680:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+11:9589:x1877767510575872:12345-192.168.202.2@tcp:35:touch.500 Request processed in 505us (1469us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790778891.380689:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1790778891.406158:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.409914:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510576000 00000100:00100000:3.0:1790778891.409938:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510576000 00000100:00100000:3.0:1790778891.410053:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1790778891.410066:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+11:9590:x1877767510576000:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:3.0:1790778891.410106:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778891.410147:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074a3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcb9b expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.410273:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.410295:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.410310:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778891.410382:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790778891.410386:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778891.410475:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.410508:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074a3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb9b expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.410722:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb9b expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.410733:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:3.0:1790778891.410737:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790778891.410741:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aac00, rc 0) 00000100:00100000:3.0:1790778891.410840:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+12:9590:x1877767510576000:12345-192.168.202.2@tcp:101:rm.0 Request processed in 776us (4695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778891.410849:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1790778891.420351:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.420991:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510576256 00000100:00100000:3.0:1790778891.421007:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510576256 00000100:00100000:3.0:1790778891.421109:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1790778891.421130:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+12:9590:x1877767510576256:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:3.0:1790778891.421163:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778891.421192:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074a48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcba2 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778891.421532:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790778891.429208:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074a48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcba2 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.429233:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef23621ab00) 00010000:00010000:2.0:1790778891.429237:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778891.429242:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074a48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcba2 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.429258:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:2.0:1790778891.429331:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:9590:x1877767510576256:12345-192.168.202.2@tcp:101:rm.0 Request processed in 8212us (8992us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790778891.429341:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:0.0:1790778891.437193:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.437291:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510576384 00000100:00100000:1.0:1790778891.437309:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510576384 00000100:00100000:1.0:1790778891.437393:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1790778891.437407:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:9590:x1877767510576384:12345-192.168.202.2@tcp:37:rm.0 00000100:00100000:1.0:1790778891.448697:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:9590:x1877767510576384:12345-192.168.202.2@tcp:37:rm.0 Request processed in 11278us (11498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778891.448714:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1790778891.452773:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.452949:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510576640 00000100:00100000:1.0:1790778891.452973:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510576640 00000100:00100000:1.0:1790778891.453048:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1790778891.453061:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:9590:x1877767510576640:12345-192.168.202.2@tcp:35:rm.0 00000100:00100000:1.0:1790778891.453758:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:9590:x1877767510576640:12345-192.168.202.2@tcp:35:rm.0 Request processed in 696us (995us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790778891.453769:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1790778891.464619:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.464733:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510576896 00000100:00100000:3.0:1790778891.464747:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510576896 00000100:00100000:3.0:1790778891.464879:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1790778891.464892:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:9590:x1877767510576896:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:3.0:1790778891.464925:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778891.464962:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcba9 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.465154:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074a5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.465175:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.465192:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778891.465208:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790778891.466363:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcba9 expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.466399:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcba9 expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.466411:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:3.0:1790778891.466415:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790778891.466420:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aba00, rc 0) 00000100:00100000:3.0:1790778891.466569:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510576896:12345-192.168.202.2@tcp:101:rm.0 Request processed in 1678us (1962us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790778891.466579:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:1.0:1790778891.478701:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778891.478840:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510577024 00000100:00100000:0.0:1790778891.478854:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510577024 00000100:00100000:0.0:1790778891.479012:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1790778891.479026:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510577024:12345-192.168.202.2@tcp:41:rm.0 00000004:00000024:0.0:1790778891.479102:0:5951:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7384293376 00000100:00100000:0.0:1790778891.479248:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510577024:12345-192.168.202.2@tcp:41:rm.0 Request processed in 224us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778891.479269:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1790778891.485134:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778891.495266:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510577152 00000100:00100000:1.0:1790778891.495291:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510577152 00000100:00100000:1.0:1790778891.495774:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:1.0:1790778891.495789:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510577152:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:1.0:1790778891.495819:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778891.495846:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074a6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbb0 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.495932:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496144:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496162:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496206:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496216:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496238:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496403:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496413:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496421:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778891.496492:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790778891.496498:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778891.496521:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496535:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496544:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496551:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496570:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496577:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.496582:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496592:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496607:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:1.0:1790778891.496610:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778891.496616:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496623:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496640:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496648:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496654:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496660:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.496664:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496681:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496691:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3849b3c7 (ffff9ef215c54e00) 00010000:00010000:1.0:1790778891.496693:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778891.496697:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496703:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496744:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656074a6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbb0 expref: 18 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496760:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbb0 expref: 17 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.496768:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef215c54400) 00010000:00010000:1.0:1790778891.496771:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778891.496774:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387c00, rc 0) 00000100:00100000:1.0:1790778891.496872:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+17:9590:x1877767510577152:12345-192.168.202.2@tcp:101:rm.0 Request processed in 1086us (11764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778891.496882:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:1.0:1790778891.509528:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778891.509645:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510577408 00000100:00100000:2.0:1790778891.509661:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510577408 00000100:00100000:2.0:1790778891.509742:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1790778891.509755:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+17:9590:x1877767510577408:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:2.0:1790778891.509837:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790778891.509879:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbb0 expref: 17 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.509911:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656074a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb94 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.509943:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef215c54400) 00010000:00010000:2.0:1790778891.509977:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb9b expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.509988:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:2.0:1790778891.509992:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778891.510018:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510035:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510047:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510063:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510071:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510078:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510218:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510240:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510260:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790778891.510644:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790778891.510659:0:5949:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 285386215733ns, next at 286386211537ns, rc = 0 00010000:00010000:2.0:1790778891.510728:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510739:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510746:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510754:0:5949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510761:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510769:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510796:0:5949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790778891.510821:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510829:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510836:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510849:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778891.510856:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510865:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510875:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778891.510879:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790778891.510883:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510889:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656074a95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510910:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510917:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510923:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510928:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778891.510931:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510936:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510956:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:2.0:1790778891.510959:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778891.510962:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778891.510968:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074a87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790778891.510980:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcd8c10f reply state 00000000ac850988 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778891.510990:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778891.511112:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510577408:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1357us (1596us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790778891.511135:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00010000:00010000:3.0:1790778891.511144:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778891.511158:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.511168:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4d400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778891.511173:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.511189:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.511201:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778891.511204:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790778891.511208:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.511215:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.511231:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778891.511233:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778891.511235:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778891.515685:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.515704:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.515710:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.515714:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4ca00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778891.515718:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.515724:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.515746:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3849b3c7 (ffff9ef2363a9d00) 00010000:00010000:3.0:1790778891.515767:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778891.515771:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.515776:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074a8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3849b3c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778891.516037:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778891.517034:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510577664 00000100:00100000:2.0:1790778891.517053:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510577664 00000100:00100000:2.0:1790778891.517149:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1790778891.517164:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+15:9590:x1877767510577664:12345-192.168.202.2@tcp:35:rm.0 00000100:00100000:2.0:1790778891.517621:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510577664:12345-192.168.202.2@tcp:35:rm.0 Request processed in 459us (1586us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790778891.517633:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1790778891.520974:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778891.521114:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510577920 00000100:00100000:3.0:1790778891.521139:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510577920 00000100:00100000:3.0:1790778891.521272:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1790778891.521285:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+16:9590:x1877767510577920:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:3.0:1790778891.521375:0:5950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790778891.521412:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcba9 expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521472:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560749fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb86 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521486:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621ac00) 00010000:00010000:3.0:1790778891.521506:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef201498800/0xdc876326560749bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb78 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521548:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef23621ab00) 00010000:00010000:3.0:1790778891.521556:0:5950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778891.521600:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521746:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521784:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521800:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521808:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521814:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521920:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521929:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.521936:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778891.522917:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790778891.522942:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.522952:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.522960:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.522966:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abe00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778891.522986:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.522998:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523012:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef23621a500) 00010000:00010000:3.0:1790778891.523015:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790778891.523019:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523026:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abe00/0xdc87632656074ab1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523950:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523958:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523965:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523971:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778891.523976:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523984:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.523996:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef23621a600) 00010000:00010000:3.0:1790778891.523999:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778891.524015:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778891.524022:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074aa3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790778891.524313:0:5950:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad7671a9 reply state 000000000b210dba transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778891.524326:0:5950:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790778891.524837:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:9590:x1877767510577920:12345-192.168.202.2@tcp:36:rm.0 Request processed in 3547us (3880us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790778891.524849:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00010000:00010000:1.0:1790778891.527822:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.527842:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.527871:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.527879:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778891.527884:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.527894:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.527914:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef23621a800) 00010000:00010000:1.0:1790778891.527917:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778891.527923:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778891.527927:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074aaa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778892.049249:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778893.067616:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790778893.323931:0:7118:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 287199484951ns, next at 288199480587ns, rc = 0 00000100:00100000:3.0:1790778893.324400:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531581952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778893.324565:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778893.324671:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531581952 00000100:00100000:3.0:1790778893.324680:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531581952 00000100:00100000:3.0:1790778893.324735:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790778893.324745:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531581952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778893.324774:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778893.324820:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531581952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778893.324827:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790778893.324847:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790778893.324879:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2364e2d80 x1877767531581952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778893.324898:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531581952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778893.327057:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778893.327142:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778893.327233:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582080 00000100:00100000:0.0:1790778893.327243:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582080 00000100:00100000:0.0:1790778893.327327:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790778893.327336:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531582080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778893.327369:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778893.327421:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531582080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778893.327428:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790778893.327933:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236615180 x1877767531582080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778893.327955:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531582080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790778893.328002:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790778894.094638:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778895.119710:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778895.183366:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778895.183480:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778895.183511:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778895.183551:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778895.183594:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578304 00000100:00100000:3.0:1790778895.183607:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578304 00000100:00100000:0.0:1790778895.183772:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578048 00000100:00100000:0.0:1790778895.183777:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578048 00000100:00100000:0.0:1790778895.183837:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 248 00000100:00100000:0.0:1790778895.183847:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510578048:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778895.183938:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510578048:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 93us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778895.183946:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 248 00000100:00100000:3.0:1790778895.184230:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1790778895.184240:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510578304:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778895.184279:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510578304:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 41us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778895.184286:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1790778895.184306:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578176 00000100:00100000:3.0:1790778895.184310:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578176 00000100:00100000:3.0:1790778895.184339:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578432 00000100:00100000:3.0:1790778895.184342:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578432 00000100:00100000:3.0:1790778895.184362:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:3.0:1790778895.184369:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:2344:x1877767510578176:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778895.184400:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:2344:x1877767510578176:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778895.184406:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:3.0:1790778895.184418:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:3.0:1790778895.184424:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2344:x1877767510578432:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778895.184476:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2344:x1877767510578432:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 52us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778895.184494:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00080000:3.0:1790778895.184515:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778895.184520:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1790778895.496356:0:12009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1790778896.141605:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778896.396782:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531582208:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.396894:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.396970:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531582720:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.397005:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.397034:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790778896.397039:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531582336:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.397061:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.397090:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531582848:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.397115:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.397148:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531582592:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.397171:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.397213:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790778896.397220:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531582464:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.397245:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.397277:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582208 00000100:00100000:2.0:1790778896.397285:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582208 00000100:00100000:2.0:1790778896.397334:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790778896.397343:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531582208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.397400:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531582208:12345-0@lo:400:kworker.0 Request processed in 58us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778896.397407:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1790778896.397463:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582848 00000100:00100000:2.0:1790778896.397934:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582848 00000100:00100000:2.0:1790778896.397981:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582592 00000100:00100000:2.0:1790778896.397984:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582592 00000100:00100000:2.0:1790778896.398002:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790778896.398009:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.398051:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531582848:12345-0@lo:400:kworker.0 Request processed in 43us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778896.398058:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790778896.398095:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790778896.398101:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531582592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.398135:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531582592:12345-0@lo:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778896.398142:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1790778896.398190:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef206d74000 x1877767531582592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778896.398207:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531582592:0@lo:400:kworker.0 00010000:00080000:2.0:1790778896.398243:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365cc000 x1877767531582848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778896.398253:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531582848:0@lo:400:kworker.0 00000100:00100000:2.0:1790778896.398263:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531582208:0@lo:400:kworker.0 00000100:00100000:3.0:1790778896.411125:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582720 00000100:00100000:3.0:1790778896.411139:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582720 00000100:00100000:3.0:1790778896.411362:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582336 00000100:00100000:3.0:1790778896.411367:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582336 00000100:00100000:3.0:1790778896.411545:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531582464 00000100:00100000:3.0:1790778896.411549:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531582464 00000100:00100000:3.0:1790778896.411636:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790778896.411647:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531582720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778896.411743:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531582720:12345-0@lo:400:kworker.0 Request processed in 97us (14735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778896.411750:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790778896.411767:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790778896.411772:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531582336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778896.411799:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531582336:12345-0@lo:400:kworker.0 Request processed in 28us (14738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778896.411805:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790778896.411814:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790778896.411820:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531582464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778896.411854:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531582464:12345-0@lo:400:kworker.0 Request processed in 34us (14608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778896.411860:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1790778896.411893:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778896.411899:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778896.411901:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778896.411952:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531582464:0@lo:400:kworker.0 00000100:00100000:3.0:1790778896.411991:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531582336:0@lo:400:kworker.0 00000100:00100000:3.0:1790778896.412002:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531582720:0@lo:400:kworker.0 00000020:00000080:1.0:1790778896.764864:0:12057:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3b5225f0 20000000:00000080:1.0:1790778896.764888:0:12057:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef2364c7400 uarg=0000000000000000 20000000:01000000:1.0:1790778896.764947:0:12057:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790778896.764954:0:12057:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790778896.764960:0:12057:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1790778896.765823:0:12058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790778896.766021:0:12057:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1790778896.772341:0:12057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1790778896.772411:0:12057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1790778896.772430:0:12057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1790778896.772831:0:12057:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790778896.772858:0:12057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772889:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607495a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772899:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074968 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772905:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074976 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772916:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772923:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772931:0:12057:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.772982:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 12 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773003:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 12 pid: 5942 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.773021:0:12057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531582976:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778896.773184:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773204:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.773213:0:12057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583104:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778896.773249:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074976 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773258:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074976 expref: 18 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.773269:0:12057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583232:0@lo:104: 00000100:00100000:1.0:1790778896.773309:0:12057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778896.773347:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656074968 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773355:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656074968 expref: 18 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.773363:0:12057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583360:0@lo:104: 00000100:00100000:1.0:1790778896.773380:0:12057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778896.773417:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531583232 00000100:00100000:1.0:1790778896.773428:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531583232 00000100:00100000:1.0:1790778896.773529:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531583360 00000100:00100000:1.0:1790778896.773532:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531583360 00000100:00100000:1.0:1790778896.773550:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790778896.773560:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:12057:x1877767531583232:12345-0@lo:104: 00010000:00010000:1.0:1790778896.773575:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773716:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790778896.773723:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+4:12057:x1877767531583232:12345-0@lo:104: Request processed in 164us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778896.773730:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790778896.773749:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790778896.773755:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:12057:x1877767531583360:12345-0@lo:104: 00010000:00010000:1.0:1790778896.773763:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773792:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790778896.773798:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:12057:x1877767531583360:12345-0@lo:104: Request processed in 43us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778896.773804:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1790778896.773852:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607495a expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.773862:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607495a expref: 18 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.773872:0:12057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583488:0@lo:104: 00000100:00100000:1.0:1790778896.773896:0:12057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778896.773921:0:5932:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790778896.773930:0:5932:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531583488 00000100:00100000:1.0:1790778896.773933:0:5932:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531583488 00000100:00100000:1.0:1790778896.773951:0:5932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790778896.773957:0:5932:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235b11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:12057:x1877767531583488:12345-0@lo:104: 00010000:00010000:1.0:1790778896.773964:0:5932:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774004:0:5932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790778896.774008:0:5932:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235b11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:763f742b-0483-425a-8826-84839ee976ad+3:12057:x1877767531583488:12345-0@lo:104: Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778896.774014:0:5932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790778896.774051:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790778896.774057:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774064:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387600 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778896.774068:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774088:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778896.774094:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778896.774100:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790778896.774125:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774132:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778896.774149:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774156:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef236387600/0xdc87632656074976 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607497d expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774179:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790778896.774183:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774188:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4cc00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778896.774190:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774196:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778896.774201:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778896.774206:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790778896.774219:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774225:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778896.774231:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774236:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4cc00/0xdc87632656074968 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607496f expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774245:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778896.774248:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774263:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201499e00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778896.774266:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774272:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778896.774278:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778896.774283:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790778896.774297:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774303:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778896.774319:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774325:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef201499e00/0xdc8763265607495a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656074961 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.774350:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778896.774353:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778896.774355:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778896.774363:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778896.774375:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531583872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778896.774403:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778896.774436:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531583872 00000100:00100000:1.0:1790778896.774511:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531583872 00010000:00010000:1.0:1790778896.774538:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607495a expref: 19 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.774562:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790778896.774569:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531583872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778896.774736:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778896.774744:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778896.774765:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531583616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778896.774798:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778896.774895:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778896.774902:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531583744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778896.774928:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778896.774957:0:5935:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790778896.774967:0:5935:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790778896.775487:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531583616 00000100:00100000:3.0:1790778896.775494:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531583616 00010000:00010000:3.0:1790778896.775520:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074976 expref: 20 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778896.775539:0:5935:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790778896.775544:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531583744 00000100:00100000:3.0:1790778896.775547:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531583744 00010000:00010000:3.0:1790778896.775556:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074968 expref: 21 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778896.775565:0:5935:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790778896.775572:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790778896.775579:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+21:3439:x1877767531583616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778896.775605:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778896.775611:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074976 expref: 21 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778896.775629:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074976 expref: 21 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778896.775646:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778896.775687:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+21:3439:x1877767531583616:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778896.775694:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790778896.775710:0:5935:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790778896.775716:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778896.775722:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+20:3439:x1877767531583744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778896.775729:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778896.775732:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656074968 expref: 20 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778896.775741:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656074968 expref: 20 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778896.775750:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778896.775772:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:763f742b-0483-425a-8826-84839ee976ad+20:3439:x1877767531583744:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778896.775778:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778896.775812:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531583744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778896.775822:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531583616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790778896.777278:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778896.777295:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607495a expref: 19 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.777310:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607495a expref: 19 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.777324:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778896.777386:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531583872:12345-0@lo:103:ldlm_bl.0 Request processed in 2817us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778896.777397:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790778896.777538:0:12057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6c300 going to sleep for 11 seconds 00010000:00010000:1.0:1790778896.777564:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4de00/0xdc8763265607497d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074976 expref: 18 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.777578:0:12057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583232:0@lo:104: 00000100:00100000:0.0:1790778896.777706:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531583872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790778896.777839:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4c600/0xdc8763265607496f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656074968 expref: 17 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.777850:0:12057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583360:0@lo:104: 00010000:00010000:1.0:1790778896.777861:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a1400/0xdc87632656074961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607495a expref: 16 pid: 5943 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778896.777869:0:12057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583488:0@lo:104: 00000100:00100000:1.0:1790778896.782034:0:12057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531582976:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778896.782054:0:12057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1877767531583104:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778896.782103:0:12057:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790778896.782411:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790778896.783045:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1790778896.783059:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790778896.783912:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778896.783937:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531584000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790778896.784016:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778896.785016:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584000 00000100:00100000:2.0:1790778896.785030:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584000 00000100:00100000:2.0:1790778896.785107:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790778896.785117:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531584000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790778896.785149:0:6934:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790778896.785250:0:6934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abd1e0b, atime: 0x6abd1e0b, ctime: 0x6abd1e0b, blocks: 0x0 00010000:00010000:2.0:1790778896.785261:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.785283:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1790778896.785288:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778896.785296:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.785325:0:6934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.785336:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.785344:0:6934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.785363:0:6934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790778896.785568:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531584000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 453us (1553us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790778896.785576:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790778896.786819:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778896.786829:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.786841:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778896.786846:0:6950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.786857:0:6950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.786875:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.786905:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656074abf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778896.786929:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778896.786932:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778896.786934:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790778896.786995:0:3441:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236425500/2, rc 0, transno 4294967300 00000100:00100000:2.0:1790778896.787004:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531584000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790778896.788759:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778896.788841:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778896.789137:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578560 00000100:00100000:3.0:1790778896.789147:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578560 00010000:00010000:3.0:1790778896.789190:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 13 pid: 5942 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778896.789256:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578688 00000100:00100000:3.0:1790778896.789260:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578688 00010000:00010000:3.0:1790778896.789273:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 14 pid: 5944 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778896.789310:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:0.0:1790778896.789323:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d2500a-b265-416e-aebe-5cbe8594cb7d+14:2346:x1877767510578560:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778896.789339:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778896.789344:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 14 pid: 5942 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789355:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 14 pid: 5942 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789375:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a1c00/0xdc8763265607498b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb6a expref: 14 pid: 5942 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789390:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778896.789501:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510578560:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 181us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778896.789509:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:0.0:1790778896.789529:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1790778896.789536:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:2345:x1877767510578688:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778896.789544:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778896.789566:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789575:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789597:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201498c00/0xdc87632656074984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb63 expref: 12 pid: 5944 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789628:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789637:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789653:0:12059:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789659:0:12059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789666:0:12059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789673:0:12059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789680:0:12059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790778896.789684:0:12059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789692:0:12059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789716:0:12059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778896.789727:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778896.789747:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:2345:x1877767510578688:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 211us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778896.789754:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00010000:00010000:1.0:1790778896.790157:0:12057:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.790168:0:12057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778896.790175:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236386600/0xdc87632656074ab8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778897.164295:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778898.189084:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778898.443652:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778898.443672:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531584128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778898.443729:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778898.443855:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584128 00000100:00100000:2.0:1790778898.443864:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584128 00000100:00100000:2.0:1790778898.443939:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790778898.443950:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531584128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778898.443997:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778898.444044:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531584128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.444049:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1790778898.444206:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236615180 x1877767531584128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790778898.444263:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778898.445168:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531584128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778898.452718:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778898.452754:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531584256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778898.452845:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778898.452913:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584256 00000100:00100000:3.0:1790778898.452936:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584256 00000100:00080000:0.0:1790778898.453134:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778898.453159:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790778898.453174:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531584256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790778898.453243:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778898.453299:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531584256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.453307:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790778898.453397:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531584256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778898.702549:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778898.704045:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578816 00000100:00100000:2.0:1790778898.704072:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578816 00000100:00100000:2.0:1790778898.704154:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 250 00000100:00100000:2.0:1790778898.704165:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:5437:x1877767510578816:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778898.704188:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778898.704214:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4c000/0xdc87632656074ac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbb7 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.704247:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4c000/0xdc87632656074ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbb7 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.704259:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4c000/0xdc87632656074ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbb7 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.704268:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c000, rc 0) 00000100:00100000:2.0:1790778898.704337:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510578816:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.704345:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 250 00000100:00100000:2.0:1790778898.711254:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778898.711883:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510578944 00000100:00100000:0.0:1790778898.711898:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510578944 00000100:00100000:2.0:1790778898.714974:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 251 00000100:00100000:2.0:1790778898.715009:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510578944:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.715380:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510578944:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 390us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.715390:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 251 00000100:00100000:1.0:1790778898.719042:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778898.719238:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579072 00000100:00100000:2.0:1790778898.719253:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579072 00000100:00100000:2.0:1790778898.719327:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 252 00000100:00100000:2.0:1790778898.719340:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510579072:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.720219:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510579072:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 878us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.720233:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 252 00000100:00100000:3.0:1790778898.725541:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778898.725682:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579200 00000100:00100000:0.0:1790778898.725700:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579200 00000100:00100000:0.0:1790778898.725790:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 253 00000100:00100000:0.0:1790778898.725801:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:9861:x1877767510579200:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778898.725990:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:9861:x1877767510579200:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 190us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.725998:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 253 00000100:00100000:0.0:1790778898.730605:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778898.730699:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579328 00000100:00100000:2.0:1790778898.730714:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579328 00000100:00100000:2.0:1790778898.731593:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 254 00000100:00100000:2.0:1790778898.731615:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:9861:x1877767510579328:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790778898.731783:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:9861:x1877767510579328:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 179us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.731793:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 254 00000100:00100000:1.0:1790778898.735876:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778898.735996:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579456 00000100:00100000:2.0:1790778898.736012:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579456 00000100:00100000:2.0:1790778898.736111:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 255 00000100:00100000:2.0:1790778898.736123:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:5437:x1877767510579456:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778898.736141:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778898.736160:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4c200/0xdc87632656074acd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbbe expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.736192:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4c200/0xdc87632656074acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbbe expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.736203:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4c200/0xdc87632656074acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbbe expref: 13 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.736212:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c200, rc 0) 00000100:00100000:2.0:1790778898.736293:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510579456:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 170us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.736315:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 255 00000100:00100000:3.0:1790778898.741433:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778898.741795:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579584 00000100:00100000:2.0:1790778898.741811:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579584 00000100:00100000:2.0:1790778898.741888:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 256 00000100:00100000:2.0:1790778898.741903:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510579584:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.742990:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510579584:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 1009us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.743006:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 256 00000100:00100000:1.0:1790778898.749248:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778898.752782:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579712 00000100:00100000:0.0:1790778898.752799:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579712 00000100:00100000:0.0:1790778898.752878:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 257 00000100:00100000:0.0:1790778898.752889:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510579712:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.754591:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:5437:x1877767510579712:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 1694us (5342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.754616:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 257 00000100:00100000:1.0:1790778898.762127:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778898.762502:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579840 00000100:00100000:2.0:1790778898.762513:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579840 00000100:00100000:2.0:1790778898.762561:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 258 00000100:00100000:2.0:1790778898.762570:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:9864:x1877767510579840:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790778898.762744:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:9864:x1877767510579840:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 174us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.762753:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 258 10000000:01000000:0.0:1790778898.763613:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790778898.763618:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef235b0c800 from 7 10000000:01000000:0.0:1790778898.763622:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790778898.763659:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778898.763683:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778898.763694:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778898.763718:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531584384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.763764:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778898.763820:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2278faa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778898.764881:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584384 00000100:00100000:2.0:1790778898.764892:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584384 00000100:00100000:2.0:1790778898.765583:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790778898.765594:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+16:5946:x1877767531584384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778898.765617:0:5942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778898.765635:0:5942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235e4c600/0xdc87632656074adb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074ad4 expref: -99 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.765664:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235e4c600/0xdc87632656074adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074ad4 expref: 17 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.765697:0:5942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235e4c600/0xdc87632656074adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074ad4 expref: 17 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.765706:0:5942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c600, rc 0) 00000100:00100000:2.0:1790778898.766297:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531584384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 703us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.766306:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790778898.768012:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531584384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778898.768060:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778898.768074:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778898.768189:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531584512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778898.768244:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778898.768293:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790778898.768489:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584512 00000100:00100000:0.0:1790778898.768497:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584512 00000100:00100000:0.0:1790778898.768551:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790778898.768561:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531584512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.768696:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205babc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531584512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.768704:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790778898.768898:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531584512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778898.768953:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531584640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778898.768996:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778898.769027:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790778898.769178:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584640 00000100:00100000:0.0:1790778898.769183:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584640 00000100:00100000:0.0:1790778898.769217:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790778898.769224:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531584640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.769308:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531584640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.769320:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790778898.769435:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531584640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.769773:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778898.769842:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510579968 00000100:00100000:0.0:1790778898.769847:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510579968 00000100:00100000:0.0:1790778898.769884:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 262 00000100:00100000:0.0:1790778898.769892:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:9864:x1877767510579968:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790778898.769992:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:9864:x1877767510579968:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.769997:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 262 00000100:00100000:1.0:1790778898.770477:0:12072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12072:1877767531584768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778898.770523:0:12072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778898.770567:0:12072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790778898.770575:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584768 00000100:00100000:0.0:1790778898.770580:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584768 00000100:00100000:0.0:1790778898.770609:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790778898.770617:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:12072:x1877767531584768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778898.770752:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:12072:x1877767531584768:12345-0@lo:502:llog_process_th.0 Request processed in 135us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.770760:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790778898.771003:0:12072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12072:1877767531584768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778898.771023:0:12072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778898.771032:0:12072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778898.771033:0:12072:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790778898.771038:0:12072:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef235b0c800 00000020:00000080:2.0:1790778898.771112:0:12072:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790778898.771231:0:12072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12072:1877767531584896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778898.771263:0:12072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778898.771283:0:12072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21101b300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778898.771326:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531584896 00000100:00100000:0.0:1790778898.771329:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531584896 00000100:00100000:0.0:1790778898.771351:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790778898.771358:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:12072:x1877767531584896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778898.771428:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+17:12072:x1877767531584896:12345-0@lo:502:llog_process_th.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.771435:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790778898.771477:0:12072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12072:1877767531584896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778898.771494:0:12072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778898.771498:0:12072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778898.771500:0:12072:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790778898.771504:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790778898.771594:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790778898.771626:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790778898.771636:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778898.771654:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778898.771665:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790778898.771667:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef2332da000 from 7 10000000:01000000:0.0:1790778898.771669:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790778898.771688:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778898.771694:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778898.771700:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778898.771708:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.771728:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778898.771753:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778898.771775:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585024 00000100:00100000:1.0:1790778898.771780:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585024 00000100:00100000:1.0:1790778898.771811:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790778898.771819:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+17:5946:x1877767531585024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790778898.771827:0:5943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778898.771848:0:5943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236386000/0xdc87632656074ae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074ae2 expref: -99 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778898.771868:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236386000/0xdc87632656074ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074ae2 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778898.771879:0:5943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236386000/0xdc87632656074ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074ae2 expref: 18 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778898.771888:0:5943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386000, rc 0) 00000100:00100000:1.0:1790778898.771929:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531585024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778898.771936:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790778898.771951:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790778898.771963:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778898.771972:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778898.772012:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.772037:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778898.772085:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1790778898.772237:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585152 00000100:00100000:2.0:1790778898.772242:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585152 00000100:00100000:2.0:1790778898.772273:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790778898.772280:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531585152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.772381:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205ba8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531585152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.772388:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790778898.773382:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790778898.773433:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790778898.773524:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778898.773567:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778898.774882:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585280 00000100:00100000:2.0:1790778898.774893:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585280 00000100:00100000:2.0:1790778898.774951:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790778898.774961:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531585280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.775132:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531585280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778898.775141:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790778898.775212:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790778898.782667:0:12074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12074:1877767531585408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778898.782781:0:12074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778898.782843:0:12074:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778898.783383:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585408 00000100:00100000:0.0:1790778898.783395:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585408 00000100:00100000:0.0:1790778898.783484:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790778898.783496:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:12074:x1877767531585408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790778898.783933:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:12074:x1877767531585408:12345-0@lo:502:llog_process_th.0 Request processed in 438us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.783942:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790778898.784019:0:12074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12074:1877767531585408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790778898.784127:0:12074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790778898.784138:0:12074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778898.784140:0:12074:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790778898.786189:0:12074:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef2332da000 00000020:00000080:3.0:1790778898.786208:0:12074:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790778898.786346:0:12074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12074:1877767531585536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778898.786459:0:12074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778898.786526:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585536 00000100:00100000:3.0:1790778898.786533:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585536 00000100:00100000:3.0:1790778898.786589:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790778898.786599:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:12074:x1877767531585536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790778898.786731:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+18:12074:x1877767531585536:12345-0@lo:502:llog_process_th.0 Request processed in 132us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778898.786739:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790778898.786800:0:12074:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5480 going to sleep for 11 seconds 00000100:00100000:3.0:1790778898.786821:0:12074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12074:1877767531585536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790778898.786846:0:12074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790778898.786851:0:12074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790778898.786861:0:12074:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790778898.786865:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790778898.787510:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790778898.787543:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790778898.787556:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.787571:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778898.787583:0:5946:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790778898.787586:0:5946:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef211145000 from 7 10000000:01000000:2.0:1790778898.787589:0:5946:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790778898.787618:0:5946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.787627:0:5946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.787648:0:5946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778898.787667:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.787708:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778898.787747:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585664 00000100:00100000:2.0:1790778898.787748:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2332669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778898.787755:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585664 00000100:00100000:3.0:1790778898.787800:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1790778898.787809:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+18:5946:x1877767531585664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790778898.787819:0:5944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778898.787831:0:5944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014abe00/0xdc87632656074af7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656074af0 expref: -99 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778898.787854:0:5944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014abe00/0xdc87632656074af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656074af0 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778898.787865:0:5944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014abe00/0xdc87632656074af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656074af0 expref: 19 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778898.787873:0:5944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abe00, rc 0) 00000100:00100000:3.0:1790778898.787905:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531585664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778898.787912:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790778898.788366:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790778898.788381:0:5946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778898.788390:0:5946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778898.788469:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.788496:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778898.788516:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2332669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778898.790275:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585792 00000100:00100000:3.0:1790778898.790287:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585792 00000100:00100000:3.0:1790778898.790382:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790778898.790392:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531585792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790778898.790600:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531585792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778898.790618:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790778898.790705:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.790766:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.790811:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778898.793464:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531585920 00000100:00100000:0.0:1790778898.793477:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531585920 00000100:00100000:0.0:1790778898.793604:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1790778898.793624:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531585920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790778898.793750:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:5946:x1877767531585920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778898.793758:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1790778898.793910:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2332669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778898.793996:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:763f742b-0483-425a-8826-84839ee976ad:5946:1877767531585920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790778898.794585:0:12076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12076:1877767531586048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778898.794689:0:12076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778898.794707:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586048 00000100:00100000:1.0:1790778898.794713:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586048 00000100:00100000:2.0:1790778898.794715:0:12076:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233266cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778898.794746:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790778898.794907:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:12076:x1877767531586048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778898.795091:0:12076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12076:1877767531586048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778898.795116:0:12076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790778898.795126:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778898.795129:0:12076:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790778898.795136:0:12076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef211145000 00000020:00000080:2.0:1790778898.795139:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790778898.795142:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:12076:x1877767531586048:12345-0@lo:502:llog_process_th.0 Request processed in 236us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778898.795151:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1790778898.795223:0:12076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12076:1877767531586176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790778898.795248:0:12076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1790778898.795943:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790778898.796155:0:12076:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233266cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778898.798059:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586176 00000100:00100000:1.0:1790778898.798437:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586176 00000100:00100000:1.0:1790778898.798513:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790778898.798524:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:12076:x1877767531586176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790778898.798675:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:12076:x1877767531586176:12345-0@lo:502:llog_process_th.0 Request processed in 153us (3424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778898.798683:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1790778898.798796:0:12076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:763f742b-0483-425a-8826-84839ee976ad:12076:1877767531586176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790778898.798830:0:12076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790778898.798838:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790778898.798841:0:12076:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790778898.798845:0:12076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790778898.799776:0:5946:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790778898.799800:0:5946:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790778898.799811:0:5946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778898.799824:0:5946:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778899.211963:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790778899.854763:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790778900.237380:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778900.303684:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778900.303926:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580096 00000100:00100000:0.0:1790778900.303938:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580096 00000100:00100000:0.0:1790778900.304005:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 275 00000100:00100000:0.0:1790778900.304017:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510580096:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778900.304138:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510580096:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 122us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778900.304147:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 275 00000100:00100000:3.0:1790778900.308339:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778900.308415:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778900.309103:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580224 00000100:00100000:1.0:1790778900.309118:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580224 00000100:00100000:1.0:1790778900.309234:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580480 00000100:00100000:1.0:1790778900.309239:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580480 00000100:00100000:1.0:1790778900.309274:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:1.0:1790778900.309288:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510580224:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778900.309398:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510580224:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 113us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778900.309422:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:1.0:1790778900.309483:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:1.0:1790778900.309491:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510580480:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778900.309518:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510580480:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778900.309524:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00080000:3.0:1790778900.309925:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778900.314243:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778900.314419:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580352 00000100:00100000:3.0:1790778900.314433:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580352 00000100:00100000:3.0:1790778900.314549:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:3.0:1790778900.314562:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510580352:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:0.0:1790778900.314774:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778900.314909:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510580352:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 348us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778900.314917:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00010000:00010000:3.0:1790778901.259716:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778901.515772:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531586560:0@lo:400:kworker.0 00000100:00100000:0.0:1790778901.515776:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531586432:0@lo:400:kworker.0 00000100:00100000:3.0:1790778901.515860:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531586304:0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.516756:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.516886:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778901.516895:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531586688:0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.516928:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778901.517011:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586688 00000100:00100000:2.0:1790778901.517019:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586688 00000100:00100000:2.0:1790778901.517092:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790778901.517101:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531586688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.517171:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531586688:12345-0@lo:400:kworker.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.517198:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790778901.517251:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531586688:0@lo:400:kworker.0 00000100:00080000:2.0:1790778901.517282:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778901.517405:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.518247:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.518297:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531586816:0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.518555:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586304 00000100:00100000:2.0:1790778901.518562:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586304 00000100:00100000:2.0:1790778901.518616:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790778901.518626:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531586304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.518795:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531586304:12345-0@lo:400:kworker.0 Request processed in 170us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.518802:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790778901.529140:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531586944:0@lo:400:kworker.0 00000100:00100000:0.0:1790778901.529209:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778901.529322:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586944 00000100:00100000:3.0:1790778901.529333:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586944 00000100:00100000:3.0:1790778901.529584:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778901.529595:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531586944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778901.529665:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531586944:12345-0@lo:400:kworker.0 Request processed in 72us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778901.529672:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778901.529703:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778901.530195:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586560 00000100:00100000:1.0:1790778901.530202:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586560 00000100:00080000:0.0:1790778901.530268:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790778901.530273:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790778901.530308:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365cf800 x1877767531586944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778901.530324:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531586944:0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.530720:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586432 00000100:00100000:2.0:1790778901.530725:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586432 00000100:00100000:2.0:1790778901.530767:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790778901.530773:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790778901.530775:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531586432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778901.530779:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531586560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778901.530833:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531586560:12345-0@lo:400:kworker.0 Request processed in 54us (14080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.530844:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531586432:12345-0@lo:400:kworker.0 Request processed in 71us (13440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778901.530845:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790778901.530850:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790778901.530881:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531586560:0@lo:400:kworker.0 00000100:00100000:1.0:1790778901.530916:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531586432:0@lo:400:kworker.0 00000100:00100000:3.0:1790778901.531436:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531586304:0@lo:400:kworker.0 00000100:00100000:1.0:1790778901.531758:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531586816 00000100:00100000:1.0:1790778901.531763:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531586816 00000100:00100000:2.0:1790778901.532139:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790778901.532148:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531586816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778901.532209:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531586816:12345-0@lo:400:kworker.0 Request processed in 62us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778901.532217:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790778901.532292:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531586816:0@lo:400:kworker.0 00000100:00080000:1.0:1790778901.532345:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1790778902.036934:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1790778902.284433:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778903.307927:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778903.563878:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778903.563903:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531587072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778903.563976:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778903.564211:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531587200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778903.564241:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778903.564331:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587072 00000100:00100000:1.0:1790778903.564342:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587072 00000100:00100000:2.0:1790778903.564383:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587200 00000100:00100000:2.0:1790778903.564390:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587200 00000100:00100000:1.0:1790778903.564424:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790778903.564501:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790778903.564507:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778903.564557:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531587072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778903.564591:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778903.564653:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531587072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778903.564722:0:3440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790778903.564729:0:3440:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236425500, transno 4294967300 00000100:00100000:3.0:1790778903.564752:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531587072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778903.568727:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790778903.568773:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531587200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778903.568831:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778903.568937:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531587200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778903.568945:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1790778903.569026:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236617800 x1877767531587200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778903.569049:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531587200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778903.569974:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1790778904.332216:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778905.356404:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778905.425354:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778905.425506:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778905.426002:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778905.426132:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778905.426171:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580864 00000100:00100000:1.0:1790778905.426180:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580864 00000100:00100000:1.0:1790778905.426240:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1790778905.426250:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510580864:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778905.426326:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510580864:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778905.426334:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00080000:1.0:1790778905.426361:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778905.427069:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580736 00000100:00100000:2.0:1790778905.427077:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580736 00000100:00100000:2.0:1790778905.427123:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580992 00000100:00100000:2.0:1790778905.427127:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580992 00000100:00100000:2.0:1790778905.427150:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1790778905.427158:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510580736:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778905.427197:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510580736:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 40us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778905.427203:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1790778905.427216:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:2.0:1790778905.427223:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510580992:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778905.427249:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510580992:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778905.427255:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00080000:1.0:1790778905.427410:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778905.427812:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510580608 00000100:00100000:3.0:1790778905.427818:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510580608 00000100:00100000:3.0:1790778905.427900:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 277 00000100:00100000:3.0:1790778905.427908:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510580608:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778905.427951:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510580608:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778905.427958:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 277 00010000:00010000:3.0:1790778906.379772:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778906.635967:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531587456:0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636071:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.636157:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531587968:0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636184:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.636219:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790778906.636225:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531587328:0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636253:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.636272:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531587840:0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636295:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.636328:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531587584:0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636357:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.636376:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778906.636382:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531587712:0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636405:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778906.636435:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587968 00000100:00100000:2.0:1790778906.636467:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587968 00000100:00100000:2.0:1790778906.636521:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587712 00000100:00100000:2.0:1790778906.636524:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587712 00000100:00100000:2.0:1790778906.636544:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790778906.636554:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531587968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636681:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531587968:12345-0@lo:400:kworker.0 Request processed in 127us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778906.636688:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790778906.636705:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790778906.636711:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531587712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778906.636740:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531587712:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778906.636746:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790778906.636770:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587456 00000100:00100000:2.0:1790778906.636774:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587456 00000100:00100000:0.0:1790778906.636901:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587840 00000100:00100000:0.0:1790778906.636906:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587840 00000100:00100000:0.0:1790778906.636928:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587584 00000100:00100000:0.0:1790778906.636931:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587584 00000100:00100000:0.0:1790778906.636945:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790778906.636952:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531587456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778906.636999:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531587456:12345-0@lo:400:kworker.0 Request processed in 47us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.637005:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790778906.637017:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790778906.637023:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531587840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778906.637048:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531587840:12345-0@lo:400:kworker.0 Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.637053:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790778906.637065:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790778906.637070:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531587584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778906.637105:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531587584:12345-0@lo:400:kworker.0 Request processed in 35us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778906.637111:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790778906.637170:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531587840:0@lo:400:kworker.0 00000100:00100000:0.0:1790778906.637180:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531587456:0@lo:400:kworker.0 00010000:00080000:0.0:1790778906.637192:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236425500 x1877767531587968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790778906.637203:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531587968:0@lo:400:kworker.0 00000100:00100000:0.0:1790778906.637243:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531587712:0@lo:400:kworker.0 00000100:00100000:0.0:1790778906.637252:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531587584:0@lo:400:kworker.0 00000100:00100000:3.0:1790778906.637388:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531587328 00000100:00100000:3.0:1790778906.637394:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531587328 00000100:00100000:3.0:1790778906.637428:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790778906.637435:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531587328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778906.637494:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531587328:12345-0@lo:400:kworker.0 Request processed in 60us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778906.637502:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790778906.637549:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531587328:0@lo:400:kworker.0 00000100:00080000:1.0:1790778906.637845:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790778906.637851:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790778906.637854:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790778907.407737:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778908.427793:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778908.684003:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531588096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778908.684094:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778908.684428:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588096 00000100:00100000:0.0:1790778908.684439:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588096 00000100:00100000:0.0:1790778908.684543:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790778908.684554:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531588096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778908.684588:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778908.684641:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531588096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778908.684648:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1790778908.684854:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778908.685749:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531588224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778908.685811:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778908.686018:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588224 00000100:00100000:1.0:1790778908.686036:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588224 00000100:00100000:1.0:1790778908.686095:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790778908.686105:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531588224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778908.686132:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00010000:00080000:2.0:1790778908.686240:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236425500 x1877767531588096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778908.686260:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531588096:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790778908.686312:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778908.697631:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531588224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11517us (11809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778908.697648:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790778908.698252:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531588224:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1790778909.068817:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790778909.456053:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778910.475708:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778910.540250:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778910.541420:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581120 00000100:00100000:3.0:1790778910.541433:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581120 00000100:00100000:3.0:1790778910.541598:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 279 00000100:00100000:3.0:1790778910.541609:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510581120:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778910.541707:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510581120:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 100us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778910.541715:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 279 00000100:00100000:1.0:1790778910.548840:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778910.548952:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581248 00000100:00100000:0.0:1790778910.548963:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581248 00000100:00100000:0.0:1790778910.549048:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:0.0:1790778910.549082:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510581248:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778910.549426:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510581248:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 349us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778910.549436:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1790778910.550706:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778910.550748:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778910.550929:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581504 00000100:00100000:0.0:1790778910.550948:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581504 00000100:00100000:0.0:1790778910.551012:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:0.0:1790778910.551023:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510581504:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778910.551085:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510581504:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 65us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778910.551092:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1790778910.551177:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581376 00000100:00100000:3.0:1790778910.551183:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581376 00000100:00100000:3.0:1790778910.551225:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:3.0:1790778910.551233:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510581376:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778910.551268:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510581376:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778910.551275:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00080000:2.0:1790778910.552007:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778910.552013:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778911.501107:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778911.756497:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531588352:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.756593:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778911.756713:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790778911.756722:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531588480:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.756766:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778911.756804:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531588736:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.756806:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531588864:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.756855:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778911.756943:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531588992:0@lo:400:kworker.0 00000100:00100000:0.0:1790778911.757006:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588352 00000100:00100000:0.0:1790778911.757016:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588352 00000100:00100000:0.0:1790778911.757069:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790778911.757080:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531588352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.758525:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588480 00000100:00100000:1.0:1790778911.758537:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588480 00000100:00100000:1.0:1790778911.758594:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588864 00000100:00100000:1.0:1790778911.758597:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588864 00000100:00100000:1.0:1790778911.758632:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790778911.758641:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531588480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.760388:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531588480:12345-0@lo:400:kworker.0 Request processed in 1741us (3618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778911.760401:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790778911.760435:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790778911.760463:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531588864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.760501:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531588864:12345-0@lo:400:kworker.0 Request processed in 60us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778911.760507:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790778911.760560:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531588864:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.760572:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531588480:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.760856:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531588608:0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.760896:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778911.760942:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588608 00000100:00100000:1.0:1790778911.760949:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588608 00000100:00100000:1.0:1790778911.760984:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790778911.760991:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531588608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.761027:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531588608:12345-0@lo:400:kworker.0 Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778911.761033:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790778911.761060:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531588608:0@lo:400:kworker.0 00000100:00080000:1.0:1790778911.761085:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778911.761840:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778911.762094:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588992 00000100:00100000:1.0:1790778911.762105:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588992 00000100:00100000:1.0:1790778911.762182:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790778911.762192:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531588992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.762283:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531588992:12345-0@lo:400:kworker.0 Request processed in 93us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778911.762290:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1790778911.762956:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790778911.763005:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2330eed80 x1877767531588992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778911.763023:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531588992:0@lo:400:kworker.0 00000100:00100000:3.0:1790778911.764071:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778911.764913:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531588736 00000100:00100000:1.0:1790778911.764936:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531588736 00000100:00100000:1.0:1790778911.765093:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790778911.765116:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531588736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778911.768106:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531588736:12345-0@lo:400:kworker.0 Request processed in 2983us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778911.768125:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790778911.768436:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531588736:0@lo:400:kworker.0 00000100:00080000:2.0:1790778911.768683:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778911.771488:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531588352:12345-0@lo:400:kworker.0 Request processed in 14400us (14885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778911.771506:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1790778911.771612:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531588352:0@lo:400:kworker.0 00010000:00010000:3.0:1790778912.524295:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778913.547585:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778913.804234:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778913.804274:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531589120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778913.804381:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778913.804598:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589120 00000100:00100000:0.0:1790778913.804618:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589120 00000100:00100000:0.0:1790778913.804703:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790778913.804716:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531589120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790778913.804769:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778913.804833:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531589120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778913.804866:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790778913.804941:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531589120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790778913.811937:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778913.815482:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778913.815532:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531589248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778913.815650:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778913.815884:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589248 00000100:00100000:1.0:1790778913.815897:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589248 00000100:00100000:1.0:1790778913.815987:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790778913.815999:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531589248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790778913.816054:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778913.816120:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531589248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778913.816128:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1790778913.818129:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790778913.818215:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236425500 x1877767531589248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778913.818249:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531589248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790778914.571779:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778915.595818:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778915.662332:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778915.662396:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778915.662512:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581760 00000100:00100000:0.0:1790778915.662522:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581760 00000100:00100000:0.0:1790778915.662609:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:0.0:1790778915.662621:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510581760:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778915.662696:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510581760:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778915.662703:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00080000:2.0:1790778915.662820:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778915.663147:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581632 00000100:00100000:3.0:1790778915.663152:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581632 00000100:00100000:3.0:1790778915.663190:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 281 00000100:00100000:3.0:1790778915.663212:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510581632:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778915.663261:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510581632:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 51us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778915.663269:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 281 00000100:00100000:1.0:1790778915.691304:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778915.691416:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510581888 00000100:00100000:2.0:1790778915.691427:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510581888 00000100:00100000:2.0:1790778915.691536:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1790778915.691547:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2342:x1877767510581888:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:2.0:1790778915.691576:0:6937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074a33 00000100:00080000:2.0:1790778915.691585:0:6937:0:(import.c:65:import_set_state_nolock()) ffff9ef2365ba800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790778915.691642:0:6937:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1790778915.691796:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+2:2342:x1877767510581888:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 251us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778915.691803:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:0.0:1790778915.692844:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790778915.693519:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778915.695335:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778915.695504:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582016 00000100:00100000:1.0:1790778915.695515:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582016 00000100:00100000:1.0:1790778915.695612:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:1.0:1790778915.695623:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510582016:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778915.695729:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510582016:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 107us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778915.695737:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00080000:2.0:1790778915.696494:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778916.620460:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778916.875990:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531589760:0@lo:400:kworker.0 00000100:00100000:3.0:1790778916.876067:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778916.876168:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778916.876174:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531589632:0@lo:400:kworker.0 00000100:00100000:3.0:1790778916.876200:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778916.876546:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589760 00000100:00100000:0.0:1790778916.876556:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589760 00000100:00100000:0.0:1790778916.876629:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790778916.876638:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531589760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778916.876703:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531589760:12345-0@lo:400:kworker.0 Request processed in 65us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778916.876711:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790778916.876739:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589632 00000100:00100000:0.0:1790778916.876742:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589632 00000100:00100000:0.0:1790778916.876770:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790778916.876778:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531589632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778916.876809:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531589632:12345-0@lo:400:kworker.0 Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778916.876815:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790778916.876855:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531589632:0@lo:400:kworker.0 00000100:00100000:0.0:1790778916.876899:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531589760:0@lo:400:kworker.0 00000100:00080000:3.0:1790778916.877039:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778916.877045:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778916.877512:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531589376:0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.877556:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778916.877604:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531589888:0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.877629:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778916.877651:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790778916.877658:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531589504:0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.877690:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778916.877707:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531590016:0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.877726:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778916.877754:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589888 00000100:00100000:1.0:1790778916.877759:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589888 00000100:00100000:1.0:1790778916.877795:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589504 00000100:00100000:1.0:1790778916.877798:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589504 00000100:00100000:1.0:1790778916.877812:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790778916.877819:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531589888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.877885:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531589888:12345-0@lo:400:kworker.0 Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778916.877892:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790778916.877906:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790778916.877913:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531589504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.877939:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531589504:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778916.877946:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790778916.877962:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590016 00000100:00100000:1.0:1790778916.877966:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590016 00000100:00100000:1.0:1790778916.877989:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790778916.877995:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531590016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.878024:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531590016:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778916.878029:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1790778916.878043:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778916.878046:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778916.878075:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531589504:0@lo:400:kworker.0 00000100:00100000:3.0:1790778916.878606:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531589376 00000100:00100000:3.0:1790778916.878613:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531589376 00000100:00100000:3.0:1790778916.878651:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790778916.878658:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531589376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778916.878701:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531589376:12345-0@lo:400:kworker.0 Request processed in 45us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778916.878707:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00080000:1.0:1790778916.879514:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236615180 x1877767531590016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778916.879527:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531590016:0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.879538:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531589376:0@lo:400:kworker.0 00000100:00100000:1.0:1790778916.879549:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531589888:0@lo:400:kworker.0 00010000:00010000:2.0:1790778917.646918:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778918.667753:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778918.929516:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778918.929539:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531590144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778918.929609:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778918.929940:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590144 00000100:00100000:3.0:1790778918.929949:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590144 00000100:00100000:3.0:1790778918.930013:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790778918.930023:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531590144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778918.930054:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778918.930106:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531590144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778918.930113:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1790778918.930162:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236615c00 x1877767531590144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778918.930180:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531590144:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790778918.930236:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778918.931958:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778918.935620:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531590272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778918.935712:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778918.935800:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590272 00000100:00100000:3.0:1790778918.935809:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590272 00000100:00100000:3.0:1790778918.935890:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790778918.935902:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531590272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778918.935937:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778918.935988:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531590272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778918.935996:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1790778918.936019:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778918.936054:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531590272:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1790778919.308985:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790778919.692583:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778920.715702:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778920.781979:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778920.782025:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778920.782061:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778920.782172:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582144 00000100:00100000:1.0:1790778920.782182:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582144 00000100:00100000:1.0:1790778920.782233:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 283 00000100:00100000:1.0:1790778920.782243:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510582144:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778920.782329:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510582144:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778920.782337:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 283 00000100:00100000:0.0:1790778920.792542:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582400 00000100:00100000:0.0:1790778920.792559:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582400 00000100:00100000:3.0:1790778920.792606:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582272 00000100:00100000:3.0:1790778920.792612:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582272 00000100:00100000:0.0:1790778920.792639:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:0.0:1790778920.792652:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2344:x1877767510582400:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778920.792856:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2344:x1877767510582400:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 204us (10828us total) trans 0 rc 0/0 00000100:00080000:2.0:1790778920.792946:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778920.804727:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:3.0:1790778920.804748:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510582272:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778920.804869:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510582272:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 130us (22807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778920.804885:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:1.0:1790778920.808383:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000001:00100000:1.0:1790778920.974678:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:1.0:1790778920.974687:0:6930:0:(genops.c:885:class_export_put()) final put ffff9ef2365bc000/b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:2.0:1790778920.974782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2365bc000/b53b344e-0d4c-4209-a606-d24036760c61 for lustre-OST0000 00000020:00000080:2.0:1790778920.974922:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef2365ba800 for lustre-OST0000 00010000:00010000:0.0:1790778921.749585:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778921.999271:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531590528:0@lo:400:kworker.0 00000100:00100000:2.0:1790778921.999346:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778921.999661:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531591040:0@lo:400:kworker.0 00000100:00100000:2.0:1790778921.999707:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778921.999864:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790778921.999881:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531590400:0@lo:400:kworker.0 00000100:00100000:2.0:1790778921.999920:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778921.999961:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531590912:0@lo:400:kworker.0 00000100:00100000:2.0:1790778921.999989:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778922.000020:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531590656:0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.000044:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778922.000061:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790778922.000067:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531590784:0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.000087:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778922.000644:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590528 00000100:00100000:2.0:1790778922.000653:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590528 00000100:00100000:2.0:1790778922.000695:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590912 00000100:00100000:2.0:1790778922.000697:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590912 00000100:00100000:2.0:1790778922.000718:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590656 00000100:00100000:2.0:1790778922.000720:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590656 00000100:00100000:2.0:1790778922.000736:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790778922.000745:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531590528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.000806:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531590528:12345-0@lo:400:kworker.0 Request processed in 62us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778922.000814:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790778922.000844:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790778922.000851:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531590912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.000876:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531590912:12345-0@lo:400:kworker.0 Request processed in 27us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778922.001285:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590400 00000100:00100000:0.0:1790778922.001301:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590400 00000100:00100000:0.0:1790778922.001368:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1790778922.001378:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531590400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778922.001487:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531590400:12345-0@lo:400:kworker.0 Request processed in 111us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778922.001496:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790778922.001753:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790778922.001795:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790778922.001805:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531590656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.001883:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531590656:12345-0@lo:400:kworker.0 Request processed in 81us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778922.001891:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1790778922.001920:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778922.001948:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531590400:0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.001962:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531590912:0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.001972:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531590528:0@lo:400:kworker.0 00000100:00100000:0.0:1790778922.002365:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531590656:0@lo:400:kworker.0 00000100:00100000:1.0:1790778922.003337:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591040 00000100:00100000:1.0:1790778922.003348:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591040 00000100:00100000:1.0:1790778922.003472:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531590784 00000100:00100000:1.0:1790778922.003476:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531590784 00000100:00100000:2.0:1790778922.005585:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790778922.005606:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531591040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778922.005709:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531591040:12345-0@lo:400:kworker.0 Request processed in 111us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778922.005718:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1790778922.005793:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2366cb100 x1877767531591040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778922.005810:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531591040:0@lo:400:kworker.0 00000100:00080000:0.0:1790778922.006846:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790778922.006856:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778922.007034:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790778922.007057:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531590784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778922.007170:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531590784:12345-0@lo:400:kworker.0 Request processed in 125us (7081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778922.007188:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790778922.007609:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531590784:0@lo:400:kworker.0 00000001:02000400:3.0:1790778922.738866:0:12238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:35:20 (1790778920) 00010000:00010000:2.0:1790778922.764476:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778923.787740:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778924.049747:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531591168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778924.049882:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778924.050062:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591168 00000100:00100000:1.0:1790778924.050073:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591168 00000100:00100000:1.0:1790778924.050175:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790778924.050188:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531591168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778924.050231:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778924.050499:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531591168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 314us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778924.050508:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790778924.050549:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531591296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778924.050591:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790778924.051032:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778924.051060:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591296 00000100:00100000:2.0:1790778924.051066:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591296 00000100:00100000:2.0:1790778924.051126:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790778924.051159:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531591296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790778924.051186:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1790778924.051231:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531591296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778924.051238:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1790778924.051282:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef236615c00 x1877767531591296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790778940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778924.051305:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531591296:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790778924.052373:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778924.071545:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531591168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790778924.811662:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778925.293666:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778925.293930:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582528 00000100:00100000:1.0:1790778925.293941:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582528 00000100:00100000:1.0:1790778925.294024:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1790778925.294036:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:10134:x1877767510582528:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790778925.294058:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778925.294129:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbc5 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778925.294207:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778925.294221:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778925.294236:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778925.294297:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790778925.294302:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778925.294344:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778925.294532:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656074afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbc5 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778925.294665:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbc5 expref: 6 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778925.294674:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:1.0:1790778925.294678:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778925.294681:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386a00, rc 0) 00000100:00100000:1.0:1790778925.294896:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:10134:x1877767510582528:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 863us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778925.294904:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00080000:2.0:1790778925.296919:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778925.313856:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778925.314053:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582656 00000100:00100000:2.0:1790778925.314065:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582656 00000100:00100000:2.0:1790778925.314126:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1790778925.314137:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:10135:x1877767510582656:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778925.314157:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778925.314179:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbcc expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314243:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314258:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314269:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314285:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314307:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314315:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314371:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4cc00/0xdc87632656074b21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314380:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4cc00/0xdc87632656074b21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314386:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4cc00/0xdc87632656074b21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778925.314424:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790778925.314427:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778925.314497:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4cc00/0xdc87632656074b21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314510:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314517:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314524:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314530:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4d400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778925.314535:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314550:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314562:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:2.0:1790778925.314565:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778925.314570:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314576:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656074b13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314590:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314597:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314603:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314609:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778925.314611:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314617:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314624:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ef2363a8600) 00010000:00010000:2.0:1790778925.314627:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778925.314629:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314644:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656074b1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314686:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656074b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbcc expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314699:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4cc00/0xdc87632656074b21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbcc expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.314706:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef2363a8b00) 00010000:00010000:2.0:1790778925.314709:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790778925.314712:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4cc00, rc 0) 00000100:00100000:2.0:1790778925.314783:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:10135:x1877767510582656:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 647us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778925.314791:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1790778925.321278:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778925.321379:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510582912 00000100:00100000:2.0:1790778925.321391:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510582912 00000100:00100000:2.0:1790778925.321490:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1790778925.321501:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:10135:x1877767510582912:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778925.321525:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778925.321570:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074b28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbd3 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.321651:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.321678:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.321697:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323021:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323039:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323049:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323169:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4800/0xdc87632656074b3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323178:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4800/0xdc87632656074b3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323185:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4800/0xdc87632656074b3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778925.323195:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790778925.323281:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323288:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323294:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323300:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778925.323317:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323326:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323339:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef2363a8b00) 00010000:00010000:2.0:1790778925.323343:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778925.323348:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323355:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074b2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323371:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323377:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323383:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323388:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778925.323391:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323396:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323403:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ef2363a8300) 00010000:00010000:2.0:1790778925.323406:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778925.323415:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323421:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074b36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323734:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074b28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbd3 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323749:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4800/0xdc87632656074b3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbd3 expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778925.323756:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:2.0:1790778925.323758:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778925.323760:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4800, rc 0) 00000100:00100000:2.0:1790778925.323841:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:10135:x1877767510582912:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2342us (2573us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790778925.323851:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1790778925.328940:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778925.331618:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583040 00000100:00100000:2.0:1790778925.331634:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583040 00000100:00100000:2.0:1790778925.331841:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1790778925.331853:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:10135:x1877767510583040:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790778925.333949:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:10135:x1877767510583040:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 2088us (5400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778925.333962:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000040:00080000:3.0:1790778925.453033:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790778925.835995:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778925.901163:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778925.901253:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778925.901295:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778925.901483:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583296 00000100:00100000:1.0:1790778925.901498:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583296 00000100:00100000:1.0:1790778925.901569:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583424 00000100:00100000:1.0:1790778925.901573:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583424 00000100:00100000:1.0:1790778925.901624:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:1.0:1790778925.901636:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510583296:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778925.901762:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510583296:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 127us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778925.901770:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:1.0:1790778925.901979:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:1.0:1790778925.901998:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510583424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778925.902029:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510583424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 32us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778925.902036:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:3.0:1790778925.902503:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583168 00000100:00100000:3.0:1790778925.902510:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583168 00000100:00100000:3.0:1790778925.902563:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 285 00000100:00100000:3.0:1790778925.902580:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510583168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778925.902622:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510583168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 52us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778925.902629:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 285 00000100:00080000:2.0:1790778925.903287:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778926.864346:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778927.122386:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531591424:0@lo:400:kworker.0 00000100:00100000:1.0:1790778927.122438:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531591552:0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.122588:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531591808:0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.122681:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778927.122759:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531591936:0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.122798:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778927.122835:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531591680:0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.122861:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778927.122896:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591936 00000100:00100000:3.0:1790778927.122907:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591936 00000100:00100000:3.0:1790778927.122972:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591680 00000100:00100000:3.0:1790778927.122976:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591680 00000100:00100000:1.0:1790778927.123366:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778927.123393:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531592064:0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.123528:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778927.123575:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591424 00000100:00100000:0.0:1790778927.123580:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591424 00000100:00100000:1.0:1790778927.124288:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591808 00000100:00100000:1.0:1790778927.124294:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591808 00000100:00100000:1.0:1790778927.124343:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778927.124355:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531591808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.124375:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531591552 00000100:00100000:3.0:1790778927.124379:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531591552 00000100:00100000:3.0:1790778927.124433:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790778927.124454:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531591936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.124466:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790778927.124475:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531591424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.124505:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531591936:12345-0@lo:400:kworker.0 Request processed in 64us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778927.124505:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531591424:12345-0@lo:400:kworker.0 Request processed in 33us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778927.124512:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1790778927.124518:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790778927.124532:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790778927.124538:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531591680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.124551:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790778927.124558:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531591552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.124573:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531591680:12345-0@lo:400:kworker.0 Request processed in 35us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778927.124579:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790778927.124585:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531591552:12345-0@lo:400:kworker.0 Request processed in 28us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778927.124591:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1790778927.124596:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778927.124602:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778927.124610:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778927.124667:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531591552:0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.124707:0:6937:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790778927.124717:0:6937:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790778927.124861:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531592064 00000100:00100000:0.0:1790778927.124866:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531592064 00000100:00100000:1.0:1790778927.125073:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531591808:12345-0@lo:400:kworker.0 Request processed in 719us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778927.125080:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778927.125119:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531591808:0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.125185:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531591680:0@lo:400:kworker.0 00000100:00080000:3.0:1790778927.125213:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778927.125233:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531591936:0@lo:400:kworker.0 00000100:00100000:3.0:1790778927.125244:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531591424:0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.127328:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790778927.127353:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531592064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778927.128851:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531592064:12345-0@lo:400:kworker.0 Request processed in 1495us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778927.128866:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1790778927.129015:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef23674df80 x1877767531592064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790778943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778927.129035:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531592064:0@lo:400:kworker.0 00010000:00010000:3.0:1790778927.889850:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778928.604404:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778928.604519:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583552 00000100:00100000:3.0:1790778928.604532:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583552 00000100:00100000:3.0:1790778928.604619:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:3.0:1790778928.604629:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:10177:x1877767510583552:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778928.604650:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778928.604669:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbda expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604732:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604747:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604788:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604814:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604822:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604829:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604871:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604884:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604891:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604897:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778928.604902:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604909:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604920:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:3.0:1790778928.604923:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778928.604928:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604941:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604953:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604960:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604966:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.604971:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00000100:00080000:1.0:1790778928.605213:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778928.605312:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.605320:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.605328:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ef236219b00) 00010000:00010000:3.0:1790778928.605331:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778928.605334:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.605340:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.605371:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074b4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbda expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.605393:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:3.0:1790778928.605396:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778928.605401:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbda expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.605410:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790778928.605496:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:10177:x1877767510583552:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 868us (1101us total) trans 0 rc 301/301 00000100:00100000:3.0:1790778928.605503:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:3.0:1790778928.610004:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778928.610187:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583808 00000100:00100000:0.0:1790778928.610196:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583808 00000100:00100000:0.0:1790778928.610252:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1790778928.610263:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:10177:x1877767510583808:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:0.0:1790778928.610314:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778928.610339:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656074b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbc5 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.610356:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6900) 00010000:00010000:0.0:1790778928.610366:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778928.610436:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.610474:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.610483:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.610498:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.610506:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.610513:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778928.611686:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790778928.611696:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.611720:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.611728:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.611734:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778928.611739:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.611746:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.611755:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778928.611758:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778928.611772:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.611779:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074b60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778928.611794:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006ba70882 reply state 00000000105bae83 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778928.611912:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778928.612010:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+10:10177:x1877767510583808:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 1749us (2014us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790778928.612019:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00010000:00010000:2.0:1790778928.619101:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.619132:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.619141:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.619148:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778928.619217:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.619227:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.619244:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ef203c61e00) 00010000:00010000:2.0:1790778928.619247:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778928.619252:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.619259:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074b67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778928.761960:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778928.762179:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510583936 00000100:00100000:1.0:1790778928.762189:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510583936 00000100:00100000:1.0:1790778928.762246:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1790778928.762257:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:10186:x1877767510583936:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:1.0:1790778928.762299:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778928.762325:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbe1 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.762405:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656074b75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.762417:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656074b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.762429:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656074b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778928.762505:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790778928.762509:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778928.762545:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656074b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.762569:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbe1 expref: 11 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.762588:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656074b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbe1 expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.762597:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:1.0:1790778928.762600:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778928.762604:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387800, rc 0) 00000100:00100000:1.0:1790778928.762655:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+10:10186:x1877767510583936:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 400us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778928.762662:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1790778928.847043:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778928.847151:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510584064 00000100:00100000:2.0:1790778928.847172:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510584064 00000100:00100000:2.0:1790778928.847235:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1790778928.847244:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+10:10192:x1877767510584064:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778928.847266:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778928.847287:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656074b7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbe8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847367:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847394:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847405:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847420:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847426:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847433:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847555:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5a00/0xdc87632656074b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847564:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5a00/0xdc87632656074b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847571:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5a00/0xdc87632656074b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778928.847608:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790778928.847613:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778928.847650:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5a00/0xdc87632656074b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847673:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847679:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847686:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847692:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778928.847697:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847705:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847717:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:2.0:1790778928.847720:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778928.847725:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847731:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847742:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847749:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847755:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847794:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778928.847797:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847803:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847811:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ef2363a9d00) 00010000:00010000:2.0:1790778928.847813:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778928.847816:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847821:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074b8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847851:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656074b7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbe8 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847864:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5a00/0xdc87632656074b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbe8 expref: 11 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778928.847872:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778928.847874:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790778928.847876:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5a00, rc 0) 00000100:00100000:2.0:1790778928.847937:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+11:10192:x1877767510584064:12345-192.168.202.2@tcp:101:bash.0 Request processed in 694us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778928.847946:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1790778928.852149:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778928.852243:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510584320 00000100:00100000:1.0:1790778928.852251:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510584320 00000100:00100000:1.0:1790778928.852308:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:1.0:1790778928.852318:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+11:10192:x1877767510584320:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778928.852339:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778928.852357:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074b98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbef expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.852521:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.852536:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.852546:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.853843:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.853857:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.853866:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790778928.854220:0:5950:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790778928.854362:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854372:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854388:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854423:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854430:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854437:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854461:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778928.854466:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854473:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854485:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778928.854488:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778928.854492:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854499:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074b9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778928.854514:0:5950:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000792e168f reply state 00000000b2abfd05 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778928.854523:0:5950:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790778928.854562:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074b98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854576:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.854584:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:1.0:1790778928.854586:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778928.854589:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386600, rc 0) 00000100:00100000:1.0:1790778928.854664:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:10192:x1877767510584320:12345-192.168.202.2@tcp:101:bash.0 Request processed in 2348us (2521us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790778928.854673:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00010000:00010000:1.0:1790778928.859914:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.859931:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.859939:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.859946:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778928.859951:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.859959:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.859973:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef240eb6100) 00010000:00010000:1.0:1790778928.859976:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778928.859993:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.860000:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074ba6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778928.865207:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778928.865316:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510584448 00000100:00100000:1.0:1790778928.865327:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510584448 00000100:00100000:1.0:1790778928.865386:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1790778928.865395:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1877767510584448:12345-192.168.202.2@tcp:8:bash.0 00010000:00080000:1.0:1790778928.865426:0:6934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1790778928.865485:0:6934:0:(genops.c:1384:class_connect()) connect: client b53b344e-0d4c-4209-a606-d24036760c61, cookie 0xdc87632656074bbb 00002000:00100000:1.0:1790778928.865498:0:6934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b53b344e-0d4c-4209-a606-d24036760c61/ffff9ef236557000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790778928.865516:0:6934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790778928.865591:0:6934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790778928.865621:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef236555000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790778928.865687:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2342:x1877767510584448:12345-192.168.202.2@tcp:8:bash.0 Request processed in 291us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778928.865694:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1790778928.873017:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778928.873250:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510584576 00000100:00100000:1.0:1790778928.873260:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510584576 00000100:00080000:3.0:1790778928.873371:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778928.873793:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:1.0:1790778928.873804:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:0:x1877767510584576:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778928.873821:0:6935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778928.873840:0:6935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbf6 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778928.873863:0:6935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790778928.873892:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1790778928.873897:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778928.873906:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 7 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.873927:0:6935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 7 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.873940:0:6935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387e00, rc 0) 00000100:00100000:1.0:1790778928.873990:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:0:x1877767510584576:12345-192.168.202.2@tcp:101:bash.0 Request processed in 189us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778928.873997:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1790778928.879547:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778928.879978:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510584704 00000100:00100000:1.0:1790778928.879988:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510584704 00000100:00100000:1.0:1790778928.880048:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1790778928.880057:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:10192:x1877767510584704:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778928.880075:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778928.880093:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcbfd expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.880122:0:6934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.880131:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778928.880135:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778928.880140:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 8 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.880195:0:6934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778928.880209:0:6934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778928.880223:0:6934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6934:1877767531592192:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778928.880979:0:6934:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20555cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778928.889008:0:6934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6934:1877767531592192:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778928.889208:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 8 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778928.889231:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387c00, rc 0) 00000100:00100000:3.0:1790778928.889391:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:10192:x1877767510584704:12345-192.168.202.2@tcp:101:bash.0 Request processed in 9334us (9853us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778928.889400:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1790778928.892883:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778928.892951:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510584832 00000100:00100000:0.0:1790778928.892961:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510584832 00010000:00010000:0.0:1790778928.892998:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778928.893049:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1790778928.893058:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510584832:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778928.893072:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778928.893094:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.893108:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.893132:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6535f80/0xdc87632656074bc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbf6 expref: 8 pid: 6935 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.893154:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778928.893159:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778928.893167:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.893178:0:5935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778928.893211:0:5935:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778928.893250:0:5935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5935:1877767531592320:192.168.202.2@tcp:105: 00000100:00100000:0.0:1790778928.899838:0:5935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778928.909299:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778928.909504:0:5935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5935:1877767531592320:192.168.202.2@tcp:105: 00010000:00010000:3.0:1790778928.909530:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778928.910311:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510584832:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 17254us (17436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778928.910320:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00010000:00010000:2.0:1790778928.913058:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778928.913090:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510585088 00000100:00100000:2.0:1790778928.913100:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510585088 00000100:00100000:2.0:1790778928.913157:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:2.0:1790778928.913168:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:10192:x1877767510585088:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:2.0:1790778928.913491:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:10192:x1877767510585088:12345-192.168.202.2@tcp:35:bash.0 Request processed in 312us (4188us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790778928.913499:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1790778929.089348:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778929.091522:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510585344 00000100:00100000:2.0:1790778929.091535:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510585344 00000100:00100000:2.0:1790778929.091606:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1790778929.091617:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:10202:x1877767510585344:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778929.091643:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778929.091679:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc04 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778929.091933:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790778929.092051:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074bd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc04 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.092065:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:2.0:1790778929.092068:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778929.092073:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc04 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.092086:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4400, rc 0) 00000100:00100000:2.0:1790778929.092155:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+15:10202:x1877767510585344:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 539us (2815us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1790778929.092180:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:3.0:1790778929.112936:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778929.113185:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510585600 00000100:00100000:1.0:1790778929.113196:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510585600 00000100:00100000:1.0:1790778929.113253:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1790778929.113263:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:10202:x1877767510585600:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1790778929.113555:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+16:10202:x1877767510585600:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 293us (627us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790778929.113565:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1790778929.166590:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531592448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778929.166676:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778929.167048:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531592448 00000100:00100000:1.0:1790778929.167059:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531592448 00000100:00100000:1.0:1790778929.167136:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790778929.167147:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531592448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778929.167190:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778929.167241:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531592448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778929.167261:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1790778929.167388:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778929.167429:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531592448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778929.167648:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778929.167698:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778929.168010:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531592576 00000100:00100000:0.0:1790778929.168016:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531592576 00000100:00100000:0.0:1790778929.168063:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790778929.168071:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531592576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778929.168084:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778929.168121:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531592576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.168128:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1790778929.168299:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778929.168325:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778929.319919:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778929.327871:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510585728 00000100:00100000:0.0:1790778929.327888:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510585728 00000100:00100000:0.0:1790778929.327972:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1790778929.327982:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+16:10208:x1877767510585728:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778929.328008:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778929.328029:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc0b expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.328094:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.328108:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.328120:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778929.328181:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1790778929.328185:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778929.328203:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.328230:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc0b expref: 18 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.328250:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc0b expref: 17 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.328260:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:0.0:1790778929.328262:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778929.328266:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0a00, rc 0) 00000100:00100000:0.0:1790778929.328537:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+17:10208:x1877767510585728:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 555us (8626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.328546:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1790778929.338937:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.339031:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510585984 00000100:00100000:3.0:1790778929.339043:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510585984 00000100:00100000:3.0:1790778929.339103:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1790778929.339113:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+17:10208:x1877767510585984:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778929.339134:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778929.339154:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074bec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc12 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.339270:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.339286:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.339298:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778929.339310:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790778929.339426:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074bec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc12 expref: 20 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.339519:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc12 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.339528:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:3.0:1790778929.339531:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778929.339535:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aba00, rc 0) 00000100:00100000:3.0:1790778929.339601:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+19:10208:x1877767510585984:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 489us (674us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790778929.339608:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1790778929.349214:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778929.353102:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510586112 00000100:00100000:0.0:1790778929.353119:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510586112 00000100:00100000:0.0:1790778929.353199:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1790778929.353211:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+19:2343:x1877767510586112:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778929.353227:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778929.353250:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc12 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.353271:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:0.0:1790778929.353290:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778929.353364:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:2343:x1877767510586112:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 155us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.353372:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1790778929.354114:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.354232:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510586368 00000100:00100000:3.0:1790778929.354238:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510586368 00000100:00100000:3.0:1790778929.354275:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1790778929.354284:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:10208:x1877767510586368:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778929.354304:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778929.354318:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc19 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.354413:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.354426:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.354437:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778929.354497:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790778929.354597:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc19 expref: 21 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.354612:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc19 expref: 20 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.354620:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:3.0:1790778929.354622:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790778929.354625:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aae00, rc 0) 00000100:00100000:3.0:1790778929.354677:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+20:10208:x1877767510586368:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 394us (564us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790778929.354684:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1790778929.370794:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778929.375767:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510586496 00000100:00100000:0.0:1790778929.375784:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510586496 00000100:00100000:0.0:1790778929.375868:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1790778929.375879:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510586496:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:0.0:1790778929.375927:0:6937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.375949:0:6937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.375959:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790778929.375963:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778929.375967:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.376004:0:6937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.376018:0:6937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 7 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778929.376033:0:6937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6937:1877767531592704:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778929.376189:0:6937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5300 going to sleep for 11 seconds 00000100:00100000:2.0:1790778929.382159:0:6937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6937:1877767531592704:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778929.382196:0:6937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778929.382606:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778929.382707:0:6940:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510586624 00000100:00100000:1.0:1790778929.382715:0:6940:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510586624 00002000:00100000:1.0:1790778929.382772:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ef2366c8000 x1877767510586624/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:480/0 lens 504/0 e 0 to 0 dl 1790778940 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778929.382783:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2366c8000 with x1877767510586624 ext(0->12) 00010000:00010000:1.0:1790778929.382791:0:6940:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 8 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778929.382805:0:6940:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 8 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778929.382813:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef2366c8000 00000100:00100000:1.0:1790778929.382848:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1790778929.382858:0:6940:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510586624:12345-192.168.202.2@tcp:4:lfs.0 00000001:00100000:2.0:1790778929.404637:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000100:00100000:1.0:1790778929.410067:0:6940:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:2346:x1877767510586624:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 27198us (27449us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790778929.410081:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:1.0:1790778929.410094:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ef2366c8000 x1877767510586624/t4294967299(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:480/0 lens 504/448 e 0 to 0 dl 1790778940 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778929.410105:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2366c8000 with x1877767510586624 ext(0->12) 00010000:00010000:1.0:1790778929.410115:0:6940:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 9 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778929.410133:0:6940:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 9 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778929.410154:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef2366c8000 00000100:00100000:0.0:1790778929.415211:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778929.415730:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510586752 00000100:00100000:2.0:1790778929.415743:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510586752 00010000:00010000:2.0:1790778929.415817:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 9 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778929.415893:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1790778929.415940:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510586752:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778929.415987:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790778929.416144:0:5934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790778929.416161:0:5934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790778929 00002000:00010000:2.0:1790778929.416177:0:5934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790778929 00002000:00010000:2.0:1790778929.416179:0:5934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790778929 00002000:00010000:2.0:1790778929.416199:0:5934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790778929.416223:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 9 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.416256:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 9 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.416291:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008335edf2/0xdc87632656074bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbfd expref: 9 pid: 6934 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.416335:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790778929.416342:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790778929.416371:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.416389:0:5934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416480:0:6937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416491:0:6937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416528:0:6937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416539:0:6937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416548:0:6937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416564:0:6937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778929.416570:0:6937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416581:0:6937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416596:0:6937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.416773:0:6937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000487ddbc6/0xdc87632656074c16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778929.416877:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510586496:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 40999us (46093us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778929.416888:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00010000:00010000:2.0:1790778929.417246:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778929.417277:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510586752:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1340us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778929.417286:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1790778929.422857:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778929.423056:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510587008 00000100:00100000:1.0:1790778929.423071:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510587008 00000100:00100000:1.0:1790778929.423819:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1790778929.423834:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:10208:x1877767510587008:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:1.0:1790778929.423920:0:5953:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc19 expref: 20 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790778929.424404:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1790778929.424475:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1790778929.424929:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1790778929.424976:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778929.424996:0:5953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 24 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778929.425008:0:5953:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778929.425292:0:5953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 24 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778929.425308:0:5953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 24 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778929.425321:0:5953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5953:1877767531592832:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778929.425833:0:5953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2126a8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790778929.433615:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778929.434295:0:5953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5953:1877767531592832:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778929.434330:0:5953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778929.435286:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510587136 00000100:00100000:0.0:1790778929.435300:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510587136 00010000:00010000:0.0:1790778929.435359:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 25 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778929.435554:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1790778929.435567:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+25:2346:x1877767510587136:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778929.435590:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778929.435598:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 25 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.435612:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 25 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.435638:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656074bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbef expref: 25 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.435661:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:0.0:1790778929.435666:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.435678:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.435687:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.435743:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778929.435826:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+24:2346:x1877767510587136:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 261us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.435835:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00010000:00010000:3.0:1790778929.437831:0:5953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.437848:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778929.438006:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1790778929.438432:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1790778929.439240:0:5953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236715180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531592960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790778929.439328:0:5953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778929.439428:0:5953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778929.439539:0:5954:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531592960 00000100:00100000:0.0:1790778929.439549:0:5954:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531592960 00000100:00100000:0.0:1790778929.439601:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790778929.439611:0:5954:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5953:x1877767531592960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790778929.439726:0:5954:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5953:x1877767531592960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.439735:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790778929.440217:0:5953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236715180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531592960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790778929.440715:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1790778929.440823:0:5953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236715180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531593088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790778929.440917:0:5953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778929.440943:0:5953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790778929.441573:0:5954:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531593088 00000100:00100000:0.0:1790778929.441582:0:5954:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531593088 00000100:00100000:0.0:1790778929.441688:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790778929.441698:0:5954:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5953:x1877767531593088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790778929.442592:0:5954:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5953:x1877767531593088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 891us (1671us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790778929.442602:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790778929.442702:0:5953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236715180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531593088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790778929.443213:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1790778929.443268:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.443278:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.443284:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.443288:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778929.443293:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.443299:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.443314:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:3.0:1790778929.443316:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790778929.443320:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.443343:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074c1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790778929.443474:0:5953:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790778929.443534:0:5953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1790778929.443543:0:5953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323319100589ns, next at 324319099200ns, rc = 0 00000001:00080000:3.0:1790778929.443547:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1790778929.443566:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef240eb6d00) 00010000:00010000:3.0:1790778929.443570:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790778929.443577:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc19 expref: 28 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778929.444216:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:10208:x1877767510587008:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 20384us (21368us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1790778929.444233:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000020:00080000:3.0:1790778929.444238:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790778929.448340:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778929.448525:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510587264 00000100:00100000:0.0:1790778929.448539:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510587264 00000100:00100000:0.0:1790778929.448617:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1790778929.448628:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+27:10208:x1877767510587264:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778929.448661:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778929.448690:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656074c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc20 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.448815:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656074c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc20 expref: 28 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.448862:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656074c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc20 expref: 28 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.448929:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778929.448960:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790778929.448966:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1600, rc 0) 00000100:00100000:0.0:1790778929.449341:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+28:10208:x1877767510587264:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 712us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.449349:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1790778929.455342:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778929.455488:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510587520 00000100:00100000:0.0:1790778929.455502:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510587520 00000100:00100000:0.0:1790778929.455573:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790778929.455779:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:10208:x1877767510587520:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778929.456303:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+29:10208:x1877767510587520:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 719us (974us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1790778929.456312:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1790778929.513791:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.514143:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510587776 00000100:00100000:3.0:1790778929.514227:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510587776 00000100:00100000:3.0:1790778929.514355:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1790778929.514379:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+29:10218:x1877767510587776:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778929.514413:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778929.514486:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc27 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778929.514625:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790778929.514777:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc27 expref: 31 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.514814:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:3.0:1790778929.514818:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778929.514824:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc27 expref: 31 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.514840:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aae00, rc 0) 00000100:00100000:3.0:1790778929.514938:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+30:10218:x1877767510587776:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 562us (1165us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1790778929.514947:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1790778929.521135:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778929.521737:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510587904 00000100:00100000:2.0:1790778929.521781:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510587904 00000100:00100000:2.0:1790778929.521953:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:2.0:1790778929.521966:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:10218:x1877767510587904:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1790778929.522097:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522119:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522133:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522168:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522177:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522183:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522281:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522290:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522297:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790778929.522639:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522666:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522686:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522694:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522702:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778929.522707:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522716:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522730:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778929.522734:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778929.522739:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522746:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522769:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522775:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522781:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522786:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778929.522797:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522804:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522813:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef2363a9f00) 00010000:00010000:2.0:1790778929.522815:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778929.522818:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522825:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656074c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522843:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522849:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522866:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522872:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778929.522875:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522882:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522889:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778929.522891:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778929.522900:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778929.522906:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656074c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778929.523009:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:10218:x1877767510587904:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1044us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778929.523017:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:2.0:1790778929.528592:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.528689:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510588160 00000100:00100000:3.0:1790778929.528703:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510588160 00000100:00100000:3.0:1790778929.528773:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1790778929.528784:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+30:10218:x1877767510588160:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778929.529354:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+31:10218:x1877767510588160:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 569us (772us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1790778929.529363:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000040:00080000:0.0:1790778929.548340:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790778929.587902:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.588296:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510588416 00000100:00100000:3.0:1790778929.588311:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510588416 00000100:00100000:3.0:1790778929.588399:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1790778929.588411:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+31:10221:x1877767510588416:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778929.588494:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778929.588521:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc2e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.588625:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.588660:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.588814:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.588831:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.588839:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.588845:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589797:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589814:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589824:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778929.589836:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790778929.589949:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589958:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589967:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589985:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778929.589991:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.589999:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590014:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778929.590018:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778929.590022:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590030:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590050:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590056:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590063:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590068:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778929.590071:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590077:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590094:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef236219b00) 00010000:00010000:3.0:1790778929.590097:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778929.590100:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590107:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590181:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 34 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590196:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 33 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.590204:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778929.590207:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778929.590210:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:3.0:1790778929.590303:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:10221:x1877767510588416:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1893us (2415us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1790778929.590313:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:1.0:1790778929.604614:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778929.604696:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510588544 00000100:00100000:0.0:1790778929.604709:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510588544 00000100:00100000:0.0:1790778929.604801:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1790778929.604813:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+33:10221:x1877767510588544:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1790778929.604920:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.604942:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.604956:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.604999:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.605008:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.605015:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.605022:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778929.605027:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.605035:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.605048:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778929.605051:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778929.605057:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778929.605064:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778929.605616:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+33:10221:x1877767510588544:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 800us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778929.605627:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1790778929.612067:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.614802:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510588800 00000100:00100000:3.0:1790778929.614825:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510588800 00000100:00100000:3.0:1790778929.616047:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1790778929.616063:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:10221:x1877767510588800:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778929.616403:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+34:10221:x1877767510588800:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 343us (4347us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1790778929.616413:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1790778929.900579:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.900964:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510589056 00000100:00100000:3.0:1790778929.900978:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510589056 00000100:00100000:3.0:1790778929.901064:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:3.0:1790778929.901077:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+34:10252:x1877767510589056:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1790778929.901111:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778929.901140:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc35 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.901347:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.902277:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.902301:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778929.902321:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790778929.902533:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074c78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc35 expref: 37 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.902558:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc35 expref: 36 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.902568:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778929.902571:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778929.902576:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778929.902791:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+36:10252:x1877767510589056:12345-192.168.202.2@tcp:101:cat.0 Request processed in 1716us (2224us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1790778929.902822:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:1.0:1790778929.912996:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778929.913180:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778929.920195:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510589440 00000100:00100000:3.0:1790778929.920221:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510589440 00000100:00100000:3.0:1790778929.920354:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1790778929.920368:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+36:2344:x1877767510589440:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778929.920391:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778929.920425:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc35 expref: 36 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778929.920473:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778929.920480:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778929.920563:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+35:2344:x1877767510589440:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 198us (7383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778929.920572:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1790778929.921989:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510589312 00000100:00100000:0.0:1790778929.922004:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510589312 00000100:00100000:0.0:1790778929.922062:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1790778929.922071:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:10252:x1877767510589312:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:0.0:1790778929.922378:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:10252:x1877767510589312:12345-192.168.202.2@tcp:35:cat.0 Request processed in 306us (9396us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1790778929.922386:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00010000:00010000:3.0:1790778929.933058:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778930.004491:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778930.004657:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510589696 00000100:00100000:2.0:1790778930.004671:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510589696 00000100:00100000:2.0:1790778930.004779:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1790778930.004792:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:10258:x1877767510589696:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:2.0:1790778930.004824:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778930.004829:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790778930.004871:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc0b expref: 36 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.004896:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778930.004902:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778930.004919:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656074c8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc3c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.005055:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.005072:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 36 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.005107:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.005161:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 36 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.005178:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 36 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778930.005195:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531593216:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778930.005324:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233266000 going to sleep for 11 seconds 00000100:00080000:3.0:1790778930.005397:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778930.008271:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531593216:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778930.008313:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778930.010358:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778930.010506:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510589824 00000100:00100000:0.0:1790778930.010519:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510589824 00010000:00010000:0.0:1790778930.010573:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 37 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778930.010612:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:0.0:1790778930.010622:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+37:2345:x1877767510589824:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778930.010649:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778930.010658:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 37 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.010673:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 37 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.010700:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074c63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc2e expref: 37 pid: 5950 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.010740:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778930.010746:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.010767:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.010776:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.010812:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778930.010894:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+36:2345:x1877767510589824:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 272us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778930.010902:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00010000:00010000:3.0:1790778930.011086:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.011096:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778930.011120:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790778930.011324:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656074c8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 37 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.011343:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 36 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.011353:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778930.011356:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790778930.011359:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5000, rc 0) 00000100:00100000:3.0:1790778930.011393:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:10258:x1877767510589696:12345-192.168.202.2@tcp:101:dd.0 Request processed in 6605us (6953us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790778930.011402:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1790778930.015294:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778930.015792:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510589952 00000100:00100000:3.0:1790778930.015809:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510589952 00000100:00100000:3.0:1790778930.015977:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1790778930.015990:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+36:10258:x1877767510589952:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:3.0:1790778930.016022:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778930.016069:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074ca2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc43 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.016123:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.016152:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.016168:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.016331:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074ca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 38 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.016354:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 37 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.016643:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778930.016648:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778930.016653:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aae00, rc 0) 00000100:00100000:3.0:1790778930.016737:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+37:10258:x1877767510589952:12345-192.168.202.2@tcp:101:dd.0 Request processed in 749us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778930.016747:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1790778930.023428:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778930.023737:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510590208 00000100:00100000:0.0:1790778930.023762:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510590208 00000100:00100000:0.0:1790778930.023929:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:0.0:1790778930.023940:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+37:10258:x1877767510590208:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:0.0:1790778930.024618:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.024707:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.024724:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790778930.024792:0:5951:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1790778930.024819:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ce29ea7 reply state 000000001f8e4ee8 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778930.024845:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778930.025159:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+40:10258:x1877767510590208:12345-192.168.202.2@tcp:36:dd.0 Request processed in 1218us (1805us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1790778930.025169:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000020:00080000:0.0:1790778930.025176:0:5951:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790778930.038954:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.038979:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.038988:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.038995:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778930.039000:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.039008:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.039058:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778930.039061:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778930.039066:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.039072:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074cb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778930.428580:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778930.428767:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510590336 00000100:00100000:0.0:1790778930.428782:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510590336 00000100:00100000:0.0:1790778930.428876:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:0.0:1790778930.428888:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+39:10271:x1877767510590336:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:0.0:1790778930.428923:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778930.428955:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074cb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc4a expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429059:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429079:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429099:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429119:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429126:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429134:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429263:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429275:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 40 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429286:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429331:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 40 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.429351:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 40 pid: 5949 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778930.429368:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531593344:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778930.429582:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5840 going to sleep for 11 seconds 00000100:00100000:1.0:1790778930.435356:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778930.436585:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531593344:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778930.436628:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778930.439237:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510590592 00000100:00100000:2.0:1790778930.439261:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510590592 00000100:00100000:2.0:1790778930.439371:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1790778930.439385:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+41:5434:x1877767510590592:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790778930.440646:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+42:5434:x1877767510590592:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 1255us (5296us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1790778930.440660:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1790778930.447537:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778930.448046:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510590720 00000100:00100000:3.0:1790778930.448056:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510590720 00010000:00010000:3.0:1790778930.448101:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 42 pid: 5949 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778930.448239:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1790778930.448249:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+42:2345:x1877767510590720:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778930.448264:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778930.448368:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 42 pid: 5949 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.448384:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 42 pid: 5949 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.448424:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656074c94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc3c expref: 42 pid: 5949 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.448439:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778930.448489:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.448500:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.448508:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.448535:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778930.448560:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448580:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778930.448590:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+41:2345:x1877767510590720:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 340us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778930.448597:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000004:00200000:1.0:1790778930.448640:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790778930.448646:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778930.448686:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448699:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448709:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448726:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448733:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448739:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778930.448770:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448779:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448789:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778930.448792:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778930.448797:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448803:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074cbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448815:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448821:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448828:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448833:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778930.448842:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448849:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448858:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef203c61500) 00010000:00010000:1.0:1790778930.448862:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778930.448866:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448872:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074cc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448907:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074cb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc4a expref: 41 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448921:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc4a expref: 40 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.448928:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:1.0:1790778930.448930:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778930.449048:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1400, rc 0) 00000100:00100000:1.0:1790778930.449095:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+40:10271:x1877767510590336:12345-192.168.202.2@tcp:101:stat.0 Request processed in 20208us (20533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778930.449103:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000001:00080000:3.0:1790778930.450308:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:3.0:1790778930.450341:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1790778930.450364:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef2062c83c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1790778930.450369:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef2063f9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2062c8b40 00000020:00080000:3.0:1790778930.450373:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef2063f9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2363c9e00 00000020:00080000:0.0:1790778930.450462:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1790778930.450557:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778930.450585:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531593472:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1790778930.450634:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1790778930.450648:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778930.450867:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531593472 00000100:00100000:0.0:1790778930.450876:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531593472 00000100:00100000:0.0:1790778930.451345:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790778930.451356:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531593472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790778930.451393:0:12307:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1790778930.451422:0:12307:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abd1e31, atime: 0x6abd1e31, ctime: 0x6abd1e31, blocks: 0x8 00010000:00010000:0.0:1790778930.451429:0:12307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.451468:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1790778930.451473:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778930.451480:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.451496:0:12307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.451506:0:12307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.451515:0:12307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778930.451537:0:12307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790778930.451555:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778930.451562:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.451631:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790778930.451637:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.451649:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.451666:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.451673:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ebb2072/0xdc87632656074cd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778930.451692:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531593472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 335us (1041us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1790778930.451695:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778930.451698:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778930.451702:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790778930.451703:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790778930.451799:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef2366c9c00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1790778930.451805:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531593472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790778930.594683:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778930.594832:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510590976 00000100:00100000:3.0:1790778930.594842:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510590976 00000100:00100000:3.0:1790778930.594903:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1790778930.594913:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+12:10277:x1877767510590976:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:3.0:1790778930.594999:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778930.595030:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656074ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc4a expref: 12 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.595051:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778930.595056:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778930.595221:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.595235:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.595245:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778930.595283:0:5949:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1790778930.595300:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fcc331a9 reply state 0000000021b8c688 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778930.595309:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790778930.595420:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:10277:x1877767510590976:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 508us (746us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1790778930.595428:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000020:00080000:3.0:1790778930.595433:0:5949:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790778930.600314:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.600336:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.600344:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.600351:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778930.600374:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.600385:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.600406:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:1.0:1790778930.600409:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778930.600414:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.600422:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074cda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778930.803181:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778930.803727:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510591104 00000100:00100000:3.0:1790778930.803750:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510591104 00000100:00100000:3.0:1790778930.803832:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:3.0:1790778930.803844:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:10292:x1877767510591104:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:3.0:1790778930.803879:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778930.803907:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc51 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804261:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804281:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804295:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804313:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804321:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804328:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804430:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804439:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804492:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778930.804546:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790778930.804552:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778930.804581:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804609:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804619:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804627:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804634:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804641:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778930.804646:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804654:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804668:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778930.804672:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778930.804677:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804684:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804700:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804707:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804719:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804724:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778930.804727:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804733:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804751:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef236219b00) 00010000:00010000:3.0:1790778930.804754:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778930.804757:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804764:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804803:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804818:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778930.804825:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778930.804827:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778930.804830:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aba00, rc 0) 00000100:00100000:3.0:1790778930.805334:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:10292:x1877767510591104:12345-192.168.202.2@tcp:101:stat.0 Request processed in 1489us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778930.805369:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:3.0:1790778930.898105:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778930.898412:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510591360 00000100:00100000:2.0:1790778930.898428:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510591360 00000100:00100000:2.0:1790778930.898647:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1790778930.898660:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:10302:x1877767510591360:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778930.898690:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778930.898752:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc58 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778930.898896:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790778930.899534:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074cfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc58 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.899554:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:2.0:1790778930.899557:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778930.899565:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc58 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778930.899582:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5200, rc 0) 00000100:00100000:2.0:1790778930.899685:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+15:10302:x1877767510591360:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1027us (1594us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1790778930.899695:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1790778930.902708:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778930.902833:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510591616 00000100:00100000:3.0:1790778930.902846:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510591616 00000100:00100000:3.0:1790778930.902919:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790778930.902930:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:10302:x1877767510591616:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778930.903304:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+16:10302:x1877767510591616:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 374us (607us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1790778930.903313:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00010000:00010000:2.0:1790778930.958612:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778930.993387:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778930.993993:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510591872 00000100:00100000:1.0:1790778930.994007:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510591872 00000100:00100000:1.0:1790778930.994547:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:1.0:1790778930.994560:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+16:10308:x1877767510591872:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778930.994594:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778930.994624:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074d0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc5f expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.994786:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.994805:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.994817:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.994889:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778930.994907:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 17 pid: 5950 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778930.994925:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531593600:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778930.996000:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2126a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1790778931.006948:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.007628:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531593600:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778931.007668:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778931.007846:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592000 00000100:00100000:3.0:1790778931.007858:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592000 00010000:00010000:3.0:1790778931.007917:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 18 pid: 5950 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778931.007970:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:3.0:1790778931.007982:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:2345:x1877767510592000:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778931.008004:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778931.008012:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 18 pid: 5950 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.008035:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 18 pid: 5950 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.008063:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc51 expref: 18 pid: 5950 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.008096:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778931.008102:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.008114:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.008124:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.008267:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778931.008419:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+17:2345:x1877767510592000:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 438us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778931.008428:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00010000:00010000:0.0:1790778931.008909:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.008924:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778931.008951:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790778931.009175:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074d0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 18 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.009197:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 17 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.009206:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778931.009209:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790778931.009212:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387c00, rc 0) 00000100:00100000:0.0:1790778931.009254:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+17:10308:x1877767510591872:12345-192.168.202.2@tcp:101:bash.0 Request processed in 14698us (15882us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1790778931.009263:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1790778931.026348:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.026409:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778931.026599:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592512 00000100:00100000:1.0:1790778931.026614:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592512 00000100:00100000:1.0:1790778931.026782:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:1.0:1790778931.026796:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510592512:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778931.026906:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510592512:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 114us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778931.026915:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1790778931.027469:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592256 00000100:00100000:2.0:1790778931.027476:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592256 00000100:00100000:2.0:1790778931.027526:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:2.0:1790778931.027535:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+17:10308:x1877767510592256:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:2.0:1790778931.028139:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.028174:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.028189:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778931.028273:0:5951:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1790778931.028298:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008db81718 reply state 00000000ff9b9a8d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778931.028308:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778931.028420:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+20:10308:x1877767510592256:12345-192.168.202.2@tcp:36:bash.0 Request processed in 884us (2087us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1790778931.028428:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000020:00080000:2.0:1790778931.028434:0:5951:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790778931.028956:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778931.031029:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592384 00000100:00100000:1.0:1790778931.031051:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592384 00000100:00100000:1.0:1790778931.031133:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 287 00000100:00100000:1.0:1790778931.031144:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510592384:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778931.031240:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510592384:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 98us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778931.031248:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 287 00000100:00100000:1.0:1790778931.031395:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778931.031519:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592640 00000100:00100000:1.0:1790778931.031537:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592640 00000100:00080000:3.0:1790778931.036416:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778931.037753:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.037793:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592768 00000100:00100000:0.0:1790778931.037806:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592768 00000100:00100000:0.0:1790778931.037891:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1790778931.037903:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+20:10308:x1877767510592768:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778931.037957:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778931.037998:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc66 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038123:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038142:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 21 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038151:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038159:0:5951:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038178:0:5951:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038208:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 21 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.038224:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 21 pid: 7119 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778931.038239:0:5951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531593728:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778931.038346:0:5951:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5000 going to sleep for 11 seconds 00010000:00010000:3.0:1790778931.039283:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039300:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039308:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039315:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778931.039320:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039330:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039368:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778931.039372:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778931.039375:0:3425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039386:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.039392:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074d20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790778931.039507:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778931.040308:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778931.040340:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510592896 00000100:00100000:3.0:1790778931.040349:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510592896 00010000:00010000:3.0:1790778931.040391:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 21 pid: 7119 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778931.040430:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:3.0:1790778931.040938:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+21:2346:x1877767510592896:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778931.040959:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778931.040967:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 21 pid: 7119 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.041229:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 21 pid: 7119 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.041259:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778931.041264:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.041290:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.041299:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.041323:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778931.041400:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+21:2346:x1877767510592896:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 960us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778931.041408:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00010000:00010000:0.0:1790778931.041637:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074d12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc5f expref: 20 pid: 7119 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778931.041668:0:5951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531593728:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778931.041696:0:5951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.041707:0:5951:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.041714:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778931.041813:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790778931.041819:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778931.042241:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.042287:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc66 expref: 20 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.042306:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc66 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.042315:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778931.042318:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778931.042321:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:0.0:1790778931.042364:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+19:10308:x1877767510592768:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4464us (4630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778931.042372:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1790778931.047244:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778931.047481:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:1.0:1790778931.047526:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510592640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778931.047881:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510592640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 387us (16485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778931.047891:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:3.0:1790778931.048331:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510593152 00000100:00100000:3.0:1790778931.048342:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510593152 00000100:00100000:3.0:1790778931.048390:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1790778931.048399:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:10308:x1877767510593152:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1790778931.048939:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:10308:x1877767510593152:12345-192.168.202.2@tcp:35:bash.0 Request processed in 539us (1712us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1790778931.048947:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1790778931.163013:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778931.163379:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510593408 00000100:00100000:2.0:1790778931.163393:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510593408 00000100:00100000:2.0:1790778931.163508:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1790778931.163518:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+20:10318:x1877767510593408:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778931.163555:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778931.163582:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074d35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc6d expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778931.168880:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790778931.169082:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074d35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc6d expref: 22 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.169103:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:2.0:1790778931.169106:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778931.169112:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074d35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc6d expref: 22 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.169131:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4a00, rc 0) 00000100:00100000:2.0:1790778931.169264:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+21:10318:x1877767510593408:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 5745us (6260us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790778931.169276:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1790778931.172332:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.172428:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510593536 00000100:00100000:0.0:1790778931.172470:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510593536 00000100:00100000:0.0:1790778931.172555:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1790778931.172576:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:10318:x1877767510593536:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1790778931.172893:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.172915:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.172931:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.172949:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.172956:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.172962:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173058:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173067:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173073:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778931.173284:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173301:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173309:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173316:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173323:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.173328:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173337:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173350:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:0.0:1790778931.173354:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.173360:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173366:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173382:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173388:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173404:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173410:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.173413:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173420:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173428:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef235cc0600) 00010000:00010000:0.0:1790778931.173430:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.173433:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173439:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173482:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173489:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173496:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173501:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.173504:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173521:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173529:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778931.173531:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.173534:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.173540:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778931.174009:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:10318:x1877767510593536:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1432us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778931.174020:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1790778931.176596:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778931.176864:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510593792 00000100:00100000:2.0:1790778931.176877:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510593792 00000100:00100000:2.0:1790778931.176944:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1790778931.176955:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:10318:x1877767510593792:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1790778931.177510:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+22:10318:x1877767510593792:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 554us (925us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790778931.177520:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1790778931.261157:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.261384:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510594048 00000100:00100000:0.0:1790778931.261400:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510594048 00000100:00100000:0.0:1790778931.261564:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1790778931.261578:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+22:10321:x1877767510594048:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778931.261612:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778931.261855:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc74 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.261961:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.261979:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.262014:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.262031:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.262039:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.262046:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.264965:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.264995:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.265009:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778931.265024:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790778931.266968:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.266985:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.266994:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267000:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.267025:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267034:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267053:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:0.0:1790778931.267057:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.267063:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267070:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074d5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267090:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267097:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267104:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267110:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.267112:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267119:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.267137:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef235cc0600) 00010000:00010000:0.0:1790778931.268765:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.268793:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.268804:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.268907:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074d58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc74 expref: 25 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.268925:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc74 expref: 24 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.268934:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778931.268937:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778931.268940:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0800, rc 0) 00000100:00100000:0.0:1790778931.270801:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+24:10321:x1877767510594048:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 9210us (9658us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1790778931.270817:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1790778931.290488:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778931.290544:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.291154:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510594304 00000100:00100000:0.0:1790778931.291171:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510594304 00000100:00100000:0.0:1790778931.291276:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1790778931.291289:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+24:2345:x1877767510594304:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778931.291322:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778931.291355:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc74 expref: 24 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.291379:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778931.291385:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778931.291511:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+23:2345:x1877767510594304:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 225us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778931.291521:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1790778931.293031:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510594176 00000100:00100000:3.0:1790778931.293046:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510594176 00000100:00100000:3.0:1790778931.293107:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1790778931.293116:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:10321:x1877767510594176:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1790778931.293207:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293228:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293242:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293301:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293310:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293318:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293324:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778931.293330:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293338:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293351:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778931.293354:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778931.293359:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.293366:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778931.293488:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:10321:x1877767510594176:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 372us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778931.293496:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1790778931.301509:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778931.301761:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510594560 00000100:00100000:3.0:1790778931.301776:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510594560 00000100:00100000:3.0:1790778931.301849:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1790778931.301881:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:10321:x1877767510594560:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778931.302193:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+24:10321:x1877767510594560:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 313us (697us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1790778931.302202:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1790778931.596402:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778931.600962:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510594816 00000100:00100000:2.0:1790778931.600986:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510594816 00000100:00100000:2.0:1790778931.601099:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:2.0:1790778931.601111:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+24:10339:x1877767510594816:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1790778931.601155:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778931.601183:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074d82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc7b expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.601327:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074d89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.601345:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.601711:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778931.601727:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790778931.601927:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074d82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc7b expref: 27 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.601951:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074d89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc7b expref: 26 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.601962:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778931.601965:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790778931.601968:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5e00, rc 0) 00000100:00100000:2.0:1790778931.602203:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:10339:x1877767510594816:12345-192.168.202.2@tcp:101:cat.0 Request processed in 1093us (5815us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790778931.602212:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:1.0:1790778931.644604:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778931.645076:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510594944 00000100:00100000:3.0:1790778931.645090:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510594944 00000100:00100000:3.0:1790778931.645225:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:3.0:1790778931.645237:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+26:10340:x1877767510594944:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778931.645270:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778931.645298:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc82 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.645400:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.645418:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.645432:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778931.645536:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790778931.645541:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778931.645951:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.645984:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074d97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc82 expref: 28 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.646046:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc82 expref: 27 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778931.646055:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778931.646059:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790778931.646063:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778931.646240:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:10340:x1877767510594944:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1003us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778931.646250:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:2.0:1790778931.651801:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778931.652007:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510595328 00000100:00100000:3.0:1790778931.652024:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510595328 00000100:00100000:3.0:1790778931.652301:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1790778931.652315:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:10340:x1877767510595328:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778931.652944:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+28:10340:x1877767510595328:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 628us (1159us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1790778931.652954:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1790778931.660805:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778931.660924:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510595456 00000100:00100000:2.0:1790778931.660938:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510595456 00000100:00100000:2.0:1790778931.661019:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1790778931.661039:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+28:10340:x1877767510595456:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:2.0:1790778931.661060:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790778931.661092:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074d2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc66 expref: 28 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.661119:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc7b expref: 27 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.661144:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656074c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc20 expref: 26 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778931.661156:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778931.661181:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778931.661256:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+25:10340:x1877767510595456:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 227us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778931.661265:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1790778931.663917:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.664364:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510595584 00000100:00100000:0.0:1790778931.664377:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510595584 00000100:00100000:0.0:1790778931.664467:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1790778931.664479:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+25:10340:x1877767510595584:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:0.0:1790778931.664662:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.664685:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.664699:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790778931.665018:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790778931.665328:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1790778931.665422:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1790778931.665565:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+25:10340:x1877767510595584:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1085us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778931.665575:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:1.0:1790778931.691850:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778931.691968:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510595712 00000100:00100000:0.0:1790778931.691981:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510595712 00000100:00100000:0.0:1790778931.692060:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1790778931.692071:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+25:10342:x1877767510595712:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778931.692102:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778931.692143:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc89 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692263:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692285:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692300:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692318:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692326:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692333:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692513:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692523:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692531:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778931.692800:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790778931.692805:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778931.692830:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692856:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692867:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692875:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692883:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692890:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.692895:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692905:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692920:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:0.0:1790778931.692923:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.692930:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692937:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656074db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692954:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692961:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692972:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692977:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778931.692980:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692986:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.692994:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef235cc0600) 00010000:00010000:0.0:1790778931.692997:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778931.693000:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.693006:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656074dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.693044:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656074dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 27 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.693059:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 26 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778931.693067:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778931.693069:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778931.693072:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0e00, rc 0) 00000100:00100000:0.0:1790778931.694251:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+26:10342:x1877767510595712:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 2172us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778931.694280:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00010000:00010000:3.0:1790778931.980410:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778932.237588:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531593856:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.237676:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.237760:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531594368:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.237845:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.237876:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778932.237883:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531594240:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.237908:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.237973:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531593984:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238001:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.238020:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531594496:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238043:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.238062:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778932.238068:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531594112:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238088:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778932.238120:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531594368 00000100:00100000:3.0:1790778932.238131:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531594368 00000100:00100000:3.0:1790778932.238193:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531593984 00000100:00100000:3.0:1790778932.238196:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531593984 00000100:00100000:3.0:1790778932.238211:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531594112 00000100:00100000:3.0:1790778932.238214:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531594112 00000100:00100000:3.0:1790778932.238231:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790778932.238240:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531594368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238297:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531594368:12345-0@lo:400:kworker.0 Request processed in 58us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.238304:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790778932.238321:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790778932.238327:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531593984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238360:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531593984:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.238367:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790778932.238378:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790778932.238384:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531594112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238412:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531594112:12345-0@lo:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.238427:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790778932.238484:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531594240 00000100:00100000:3.0:1790778932.238488:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531594240 00000100:00100000:3.0:1790778932.238518:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531594496 00000100:00100000:3.0:1790778932.238521:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531594496 00000100:00100000:3.0:1790778932.238539:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790778932.238545:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531594240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238579:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531594240:12345-0@lo:400:kworker.0 Request processed in 34us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.238586:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790778932.238597:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790778932.238603:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531594496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238630:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531594496:12345-0@lo:400:kworker.0 Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.238635:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790778932.238687:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531594112:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238699:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531593984:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238708:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531594496:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238752:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531594240:0@lo:400:kworker.0 00000100:00100000:3.0:1790778932.238762:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531594368:0@lo:400:kworker.0 00000100:00100000:0.0:1790778932.240075:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531593856 00000100:00100000:0.0:1790778932.240086:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531593856 00000100:00080000:2.0:1790778932.240624:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778932.240630:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778932.240633:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778932.241788:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790778932.241802:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531593856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778932.241898:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531593856:12345-0@lo:400:kworker.0 Request processed in 101us (4222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.241906:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790778932.241975:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531593856:0@lo:400:kworker.0 00000040:00080000:0.0:1790778932.592562:0:12386:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778932.592573:0:12386:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778932.592633:0:12386:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790778932.593857:0:12386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790778932.620068:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778932.620078:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778932.620123:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790778932.620134:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778932.620286:0:12077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531594624:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790778932.620392:0:12077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778932.671992:0:12077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531594624:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790778932.682391:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778932.685297:0:5961:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510595840 00000100:00100000:0.0:1790778932.685311:0:5961:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510595840 00000100:00100000:0.0:1790778932.685390:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1790778932.685401:0:5961:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510595840:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790778932.685527:0:5961:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510595840:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 127us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.685543:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00080000:2.0:1790778932.686041:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778932.703585:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778932.709490:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510595968 00000100:00100000:0.0:1790778932.709506:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510595968 00000100:00100000:0.0:1790778932.709572:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1790778932.709582:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510595968:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790778932.709616:0:7119:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790778932.709756:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510595968:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 175us (6183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.709764:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1790778932.732667:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.733045:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510596096 00000100:00100000:3.0:1790778932.733054:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510596096 00000100:00100000:3.0:1790778932.733149:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:3.0:1790778932.733160:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510596096:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790778932.733254:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733272:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733286:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733301:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733309:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733316:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733342:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733351:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.733358:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778932.733412:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790778932.733416:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778932.733432:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734701:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734788:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734794:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734800:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778932.734804:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734811:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734825:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:3.0:1790778932.734828:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778932.734834:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734840:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074dc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734854:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734861:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734866:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734871:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778932.734880:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734887:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734895:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ef236219b00) 00010000:00010000:3.0:1790778932.734898:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778932.734901:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734907:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074dcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734925:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734932:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734938:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734944:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778932.734947:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734953:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734960:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778932.734962:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778932.734971:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.734977:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778932.735077:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510596096:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 1913us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.735086:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:1.0:1790778932.743486:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.743671:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510596352 00000100:00100000:3.0:1790778932.743684:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510596352 00000100:00100000:3.0:1790778932.743767:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:3.0:1790778932.743777:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:10354:x1877767510596352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778932.743801:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778932.743821:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ddd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc90 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.743925:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.743940:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.743950:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778932.743961:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790778932.744037:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744044:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744061:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744068:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aac00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778932.744072:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744080:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744093:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:3.0:1790778932.744096:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790778932.744101:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744108:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744156:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ddd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc90 expref: 28 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744168:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:3.0:1790778932.744170:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778932.744174:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ddd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc90 expref: 28 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.744183:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa200, rc 0) 00000100:00100000:3.0:1790778932.744235:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+27:10354:x1877767510596352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 460us (758us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790778932.744251:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:1.0:1790778932.750351:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778932.751259:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510596480 00000100:00100000:0.0:1790778932.751271:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510596480 00000100:00100000:0.0:1790778932.751331:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1790778932.751342:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+27:10354:x1877767510596480:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790778932.751388:0:5949:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790778932.751550:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+27:10354:x1877767510596480:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 209us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.751558:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1790778932.757257:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.757347:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510596736 00000100:00100000:3.0:1790778932.757358:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510596736 00000100:00100000:3.0:1790778932.757429:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:3.0:1790778932.757486:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+27:10354:x1877767510596736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778932.757511:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778932.757515:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790778932.757541:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc82 expref: 27 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.757558:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778932.757563:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778932.757576:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074df2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc97 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790778932.759224:0:7119:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1790778932.766124:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.766152:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.766167:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.766286:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074df2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc97 expref: 29 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.766326:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc97 expref: 28 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.766336:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219b00) 00010000:00010000:3.0:1790778932.766339:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778932.766343:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aac00, rc 0) 00000100:00100000:3.0:1790778932.766436:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:10354:x1877767510596736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 8990us (9179us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1790778932.772204:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:1.0:1790778932.773077:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778932.773132:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510596992 00000100:00100000:1.0:1790778932.773142:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510596992 00000100:00100000:1.0:1790778932.773196:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:1.0:1790778932.773205:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:10354:x1877767510596992:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790778932.773273:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778932.773304:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656074df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc97 expref: 28 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773329:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219b00) 00010000:00010000:1.0:1790778932.773356:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778932.773397:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773412:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773433:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773478:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773486:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773494:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773548:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773557:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773565:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773571:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778932.773576:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773585:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773601:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778932.773604:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778932.773609:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773616:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773628:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773635:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773642:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773647:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778932.773650:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773656:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773663:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x459d707 (ffff9ef240eb6700) 00010000:00010000:1.0:1790778932.773665:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778932.773668:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778932.773673:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x459d707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.773804:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+27:10354:x1877767510596992:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 599us (732us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790778932.773812:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:1.0:1790778932.785962:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.786068:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510597120 00000100:00100000:3.0:1790778932.786088:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510597120 00000100:00100000:3.0:1790778932.786176:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:3.0:1790778932.786189:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+27:10354:x1877767510597120:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778932.786214:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778932.786245:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcc9e expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.786291:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.786308:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.786323:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.786844:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 29 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.786876:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 28 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.786887:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:3.0:1790778932.786890:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778932.786895:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778932.790874:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+28:10354:x1877767510597120:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4669us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.790892:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:1.0:1790778932.798011:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778932.798697:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510597376 00000100:00100000:2.0:1790778932.798838:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510597376 00000100:00100000:2.0:1790778932.799002:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:2.0:1790778932.799013:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+28:10354:x1877767510597376:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790778932.799107:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.799125:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.799138:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790778932.799304:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1790778932.799314:0:5950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326674871295ns, next at 327674868757ns, rc = 0 00000004:00010000:2.0:1790778932.799366:0:5950:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004b6cfdf6 reply state 000000006e502c8f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.799387:0:5950:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778932.799536:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+30:10354:x1877767510597376:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 524us (1549us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1790778932.799557:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00010000:00010000:3.0:1790778932.827129:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.827151:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.827160:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.827167:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778932.827173:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.827181:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.827204:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:3.0:1790778932.827208:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790778932.827212:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.827235:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778932.830333:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778932.830995:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510597504 00000100:00100000:2.0:1790778932.831012:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510597504 00000100:00100000:2.0:1790778932.831080:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:2.0:1790778932.831107:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+29:10354:x1877767510597504:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778932.831134:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778932.831154:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcca5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.831212:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 30 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.831226:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 30 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.831245:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:2.0:1790778932.831248:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778932.831251:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5400, rc 0) 00000100:00100000:2.0:1790778932.831335:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:10354:x1877767510597504:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 246us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778932.831342:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:1.0:1790778932.835585:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.835673:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510597632 00000100:00100000:3.0:1790778932.835686:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510597632 00000100:00100000:3.0:1790778932.835911:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1790778932.835920:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1877767510597632:12345-192.168.202.2@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1790778932.835951:0:6934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:3.0:1790778932.835980:0:6934:0:(genops.c:1384:class_connect()) connect: client b53b344e-0d4c-4209-a606-d24036760c61, cookie 0xdc87632656074e31 00002000:00100000:3.0:1790778932.835991:0:6934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b53b344e-0d4c-4209-a606-d24036760c61/ffff9ef207d35800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790778932.836009:0:6934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790778932.836078:0:6934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790778932.836121:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef215c18800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790778932.836196:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2342:x1877767510597632:12345-192.168.202.2@tcp:8:lhsmtool_posix.0 Request processed in 275us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.836204:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:1.0:1790778932.866759:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778932.866904:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510597760 00000100:00100000:2.0:1790778932.866914:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510597760 00000100:00100000:2.0:1790778932.866983:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:2.0:1790778932.866993:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:0:x1877767510597760:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790778932.867392:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790778932.878964:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1790778932.878983:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000100:00100000:3.0:1790778932.880324:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:0:x1877767510597760:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 13321us (13574us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790778932.880339:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1790778932.884087:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778932.893990:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510598016 00000100:00100000:0.0:1790778932.894007:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510598016 00000100:00100000:1.0:1790778932.894544:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790778932.894555:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:10354:x1877767510598016:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790778932.895565:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:10354:x1877767510598016:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1006us (11481us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790778932.895575:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790778932.905193:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.905339:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510598272 00000100:00100000:3.0:1790778932.905349:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510598272 00000100:00100000:3.0:1790778932.905424:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:3.0:1790778932.905435:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+31:10354:x1877767510598272:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790778932.905573:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+31:10354:x1877767510598272:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 139us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.905594:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1790778932.910022:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778932.911253:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510598400 00000100:00100000:3.0:1790778932.911265:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510598400 00000100:00100000:3.0:1790778932.911322:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1790778932.911333:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:10354:x1877767510598400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778932.911358:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778932.911471:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccac expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.911542:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.911557:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.911568:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778932.911610:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778932.911628:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.911652:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccac expref: 33 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.911668:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccac expref: 32 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778932.911676:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:3.0:1790778932.911686:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790778932.911690:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790778932.913290:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+32:10354:x1877767510598400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1952us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778932.913301:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1790778932.936218:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778932.943824:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510598528 00000100:00100000:0.0:1790778932.943842:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510598528 00000100:00100000:0.0:1790778932.943920:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1790778932.943932:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510598528:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778932.943967:0:12307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778932.943993:0:12307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccb3 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790778932.944023:0:12307:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1e34, blocks: 0x0 00010000:00010000:0.0:1790778932.944042:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1790778932.944047:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778932.944057:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 6 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.944079:0:12307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 6 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778932.944108:0:12307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1800, rc 0) 00000100:00100000:0.0:1790778932.944193:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510598528:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 264us (7984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.944201:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1790778932.951004:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778932.952437:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510598784 00000100:00100000:0.0:1790778932.952465:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510598784 00000100:00100000:0.0:1790778932.952547:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1790778932.952558:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+32:10354:x1877767510598784:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790778932.952683:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+32:10354:x1877767510598784:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 126us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778932.952691:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1790778932.964182:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778932.964663:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510598912 00000100:00100000:2.0:1790778932.964679:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510598912 00000100:00100000:2.0:1790778932.966841:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1790778932.966860:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:10354:x1877767510598912:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778932.966891:0:6937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778932.966910:0:6937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccba expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.966941:0:6937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.966951:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778932.966955:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778932.966960:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 7 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.967011:0:6937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778932.985503:0:6937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778932.985531:0:6937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236865c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6937:1877767531594752:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778932.985683:0:6937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2040069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778933.006823:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778933.007749:0:6937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236865c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6937:1877767531594752:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778933.009988:0:6937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 7 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.010035:0:6937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4a00, rc 0) 00000100:00100000:2.0:1790778933.010129:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:10354:x1877767510598912:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 43273us (45953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778933.010138:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1790778933.012297:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510599040 00000100:00100000:1.0:1790778933.012310:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510599040 00010000:00010000:1.0:1790778933.012351:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.012394:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1790778933.012405:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510599040:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778933.012464:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778933.012490:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.012506:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.012532:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccb3 expref: 7 pid: 12307 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.012550:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778933.012555:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778933.012563:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 6 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.012575:0:5933:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 6 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.012617:0:5933:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 6 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.012632:0:5933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236725880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5933:1877767531594880:192.168.202.2@tcp:105: 00000100:00100000:1.0:1790778933.012740:0:5933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2278fa900 going to sleep for 11 seconds 00010000:00010000:1.0:1790778933.012756:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778933.028214:0:5933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236725880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5933:1877767531594880:192.168.202.2@tcp:105: 00010000:00010000:2.0:1790778933.028242:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778933.028301:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510599040:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 15898us (21486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778933.028312:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1790778933.045881:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778933.054504:0:6942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510599168 00000100:00100000:2.0:1790778933.054519:0:6942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510599168 00002000:00100000:2.0:1790778933.054565:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ef236724380 x1877767510599168/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:484/0 lens 504/0 e 0 to 0 dl 1790778944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790778933.054573:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236724380 with x1877767510599168 ext(0->8) 00002000:00010000:2.0:1790778933.054577:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236724380 00000100:00100000:2.0:1790778933.054605:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1790778933.054615:0:6942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510599168:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790778933.061019:0:6942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510599168:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 6393us (15136us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790778933.061036:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:2.0:1790778933.061050:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ef236724380 x1877767510599168/t4294967302(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:484/0 lens 504/448 e 0 to 0 dl 1790778944 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790778933.061060:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236724380 with x1877767510599168 ext(0->8) 00002000:00010000:2.0:1790778933.061927:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236724380 00000100:00100000:1.0:1790778933.065996:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778933.066115:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510599296 00000100:00100000:3.0:1790778933.066125:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510599296 00000100:00100000:3.0:1790778933.066172:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:3.0:1790778933.066182:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+32:10354:x1877767510599296:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790778933.070812:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1790778933.070833:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1790778933.070912:0:5927:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1790778933.070974:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1790778933.070995:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790778933.071128:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+14:10354:x1877767510599296:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 4931us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778933.071143:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:0.0:1790778933.071171:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531595008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790778933.071240:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778933.071379:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531595008 00000100:00100000:3.0:1790778933.071391:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531595008 00000100:00100000:3.0:1790778933.071474:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778933.071485:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531595008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790778933.072063:0:12307:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790778933.072069:0:12307:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790778933 00002000:00010000:3.0:1790778933.072072:0:12307:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790778933.072073:0:12307:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790778932 -> 1790778933 00002000:00010000:3.0:1790778933.072076:0:12307:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1790778933.072333:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3440:x1877767531595008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 850us (1092us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790778933.072353:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1790778933.073130:0:3440:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef235e39500/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790778933.073140:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531595008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790778933.077891:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778933.078073:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510599424 00000100:00100000:3.0:1790778933.078102:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510599424 00000100:00100000:3.0:1790778933.078192:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1790778933.078204:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510599424:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1790778933.080295:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1790778933.080311:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1790778933.091924:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510599424:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 13636us (13961us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778933.091944:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:1.0:1790778933.099411:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778933.099612:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510599680 00000100:00100000:0.0:1790778933.099626:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510599680 00000100:00100000:0.0:1790778933.099712:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1790778933.099735:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+14:10354:x1877767510599680:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790778933.099805:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778933.099838:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccac expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.099863:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:0.0:1790778933.099869:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778933.099909:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.099926:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.099938:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778933.100206:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004917d697 reply state 000000003ff47483 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778933.100218:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778933.100536:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+15:10354:x1877767510599680:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 813us (1140us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1790778933.100546:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00010000:00010000:2.0:1790778933.103435:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.103493:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.103502:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.103508:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778933.103514:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.103522:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.103540:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:2.0:1790778933.103543:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778933.103547:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.103553:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc87632656074e54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.107801:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778933.108364:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510599808 00000100:00100000:0.0:1790778933.108379:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510599808 00000100:00100000:0.0:1790778933.108482:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1790778933.108496:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510599808:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790778933.108754:0:6934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790778933.108759:0:6934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790778933 -> 1790778931 00002000:00010000:0.0:1790778933.108762:0:6934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790778929 00002000:00010000:0.0:1790778933.108765:0:6934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790778933 -> 1790778931 00002000:00010000:0.0:1790778933.108768:0:6934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790778933.108862:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510599808:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 359us (1064us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790778933.108871:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:1.0:1790778933.116922:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778933.117153:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600064 00000100:00100000:2.0:1790778933.117169:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600064 00000100:00100000:2.0:1790778933.117246:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1790778933.117257:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:10354:x1877767510600064:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790778933.117332:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.117371:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 14 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.117378:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.117414:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 14 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.117430:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 14 pid: 5951 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.117479:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236865c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531595136:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778933.117571:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006780 going to sleep for 11 seconds 00000100:00100000:3.0:1790778933.125541:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236865c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531595136:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778933.125579:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.128166:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778933.128793:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600192 00000100:00100000:2.0:1790778933.128810:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600192 00010000:00010000:2.0:1790778933.128880:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 15 pid: 5951 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.128929:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1790778933.128942:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:2345:x1877767510600192:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778933.128967:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778933.128977:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 15 pid: 5951 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.129005:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 15 pid: 5951 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.129062:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc9e expref: 15 pid: 5951 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.129088:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:2.0:1790778933.129094:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.129108:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.129118:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.129158:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778933.129218:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129239:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.129247:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:2345:x1877767510600192:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 304us (1092us total) trans 0 rc 0/0 00010000:00010000:3.0:1790778933.129291:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129301:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129308:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129315:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778933.129319:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129358:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129378:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:3.0:1790778933.129381:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790778933.129388:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.129394:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074e5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.129431:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1790778933.129557:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:10354:x1877767510600064:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 12296us (12644us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790778933.129568:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1790778933.134227:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778933.134392:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600320 00000100:00100000:0.0:1790778933.134406:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600320 00000100:00100000:0.0:1790778933.134506:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1790778933.134518:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510600320:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790778933.134576:0:6937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.134602:0:6937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 7 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.134613:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790778933.134618:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778933.134642:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.134704:0:6937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 7 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.134733:0:6937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 7 pid: 6937 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778933.134751:0:6937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6937:1877767531595264:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778933.134967:0:6937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778933.146427:0:6937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6937:1877767531595264:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778933.146506:0:6937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.158520:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778933.158977:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600448 00000100:00100000:1.0:1790778933.158990:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600448 00010000:00010000:1.0:1790778933.159048:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 8 pid: 6937 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.159101:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1790778933.159122:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510600448:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778933.159142:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778933.159171:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 8 pid: 6937 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.159187:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 8 pid: 6937 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.159217:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656074e4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccba expref: 8 pid: 6937 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.159237:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778933.159242:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778933.160001:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.160015:0:12059:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.160069:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778933.160195:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510600448:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1082us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778933.160203:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00010000:00010000:2.0:1790778933.160298:0:6937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160310:0:6937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160342:0:6937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160371:0:6937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160381:0:6937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160396:0:6937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778933.160401:0:6937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160412:0:6937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160431:0:6937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.160463:0:6937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656074e62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.160523:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510600320:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 26007us (26312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778933.160552:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1790778933.165831:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778933.166110:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600704 00000100:00100000:0.0:1790778933.166124:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600704 00000100:00100000:0.0:1790778933.166199:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1790778933.166238:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+13:10354:x1877767510600704:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790778933.166403:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.166490:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.166503:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.166622:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.166670:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 13 pid: 5950 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778933.167187:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531595392:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778933.167389:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778933.171547:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531595392:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778933.171870:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778933.175239:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778933.175381:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600832 00000100:00100000:0.0:1790778933.175393:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600832 00010000:00010000:0.0:1790778933.175468:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 14 pid: 5950 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778933.175502:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1790778933.175513:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+14:2346:x1877767510600832:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778933.175528:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778933.175536:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 14 pid: 5950 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.175550:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 14 pid: 5950 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.175596:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc43 expref: 14 pid: 5950 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.175614:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:0.0:1790778933.175619:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.175628:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.175653:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778933.175674:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778933.175742:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+13:2346:x1877767510600832:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 231us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778933.175750:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00010000:00010000:1.0:1790778933.185743:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.187733:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.189362:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.189396:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.189409:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.191566:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.191598:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 13 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.191629:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531595520:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778933.193241:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef207d3c300 going to sleep for 11 seconds 00000100:00100000:1.0:1790778933.202118:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531595520:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778933.202149:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778933.211088:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778933.211552:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510600960 00000100:00100000:2.0:1790778933.211563:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510600960 00010000:00010000:2.0:1790778933.211604:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 14 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.211671:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1790778933.211680:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:2345:x1877767510600960:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778933.211696:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778933.211703:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 14 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.211732:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 14 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.211752:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcca5 expref: 14 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.211769:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:2.0:1790778933.211774:0:5933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.211782:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.211790:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.211816:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778933.211879:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:2345:x1877767510600960:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 200us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778933.211886:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00010000:00010000:3.0:1790778933.212964:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.212976:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778933.213097:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1790778933.213225:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1790778933.213260:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1790778933.214462:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236845880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531595648:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790778933.214545:0:7119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778933.214582:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778933.214940:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531595648 00000100:00100000:1.0:1790778933.214948:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531595648 00000100:00100000:1.0:1790778933.215004:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790778933.215014:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7119:x1877767531595648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790778933.215127:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7119:x1877767531595648:12345-0@lo:1000:mdt00_003.0 Request processed in 115us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778933.215134:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790778933.215290:0:7119:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790778933.215302:0:7119:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef235e39500, transno 4294967303 00000100:00100000:3.0:1790778933.215511:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236845880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531595648:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790778933.215776:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1790778933.215843:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236845880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531595776:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790778933.215875:0:7119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778933.215891:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778933.221772:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531595776 00000100:00100000:1.0:1790778933.221790:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531595776 00000100:00100000:1.0:1790778933.221860:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790778933.221871:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7119:x1877767531595776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790778933.222129:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7119:x1877767531595776:12345-0@lo:1000:mdt00_003.0 Request processed in 260us (6252us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790778933.222138:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790778933.222288:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236845880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531595776:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790778933.222373:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222385:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222393:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222399:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778933.222404:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222412:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222429:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef236219600) 00010000:00010000:2.0:1790778933.222432:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778933.222437:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222486:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656074e70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222528:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222534:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222539:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222555:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778933.222558:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222563:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222571:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778933.222574:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778933.222577:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222582:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656074da5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222602:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222616:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222625:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222658:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.222672:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 16 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.222696:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236867100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531595904:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778933.222786:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778933.227228:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778933.227320:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510601088 00000100:00100000:1.0:1790778933.227331:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510601088 00010000:00010000:1.0:1790778933.227380:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 17 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778933.227425:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1790778933.227479:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+17:2346:x1877767510601088:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778933.227494:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778933.227500:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 17 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.227514:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 17 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.227537:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:1.0:1790778933.227542:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.227552:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.227559:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778933.227577:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778933.227629:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+17:2346:x1877767510601088:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778933.227646:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:2.0:1790778933.227753:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcc89 expref: 16 pid: 5949 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.227771:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236867100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531595904:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778933.227791:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227801:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227807:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227818:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227826:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227834:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227840:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778933.227845:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227852:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227869:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778933.227872:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778933.227876:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227883:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074e77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227894:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227900:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227905:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227909:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778933.227912:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227918:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227925:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef203c61800) 00010000:00010000:2.0:1790778933.227927:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790778933.227930:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.227935:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656074e69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778933.228083:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+15:10354:x1877767510600704:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 61850us (62266us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1790778933.228091:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000020:00080000:2.0:1790778933.228095:0:7119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790778933.228339:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790778933.228344:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790778933.228358:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790778933.228364:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790778933.233693:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778933.234024:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510601344 00000100:00100000:3.0:1790778933.234037:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510601344 00000100:00100000:3.0:1790778933.234098:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1790778933.234116:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:10354:x1877767510601344:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790778933.234390:0:5953:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790778933.234423:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1790778933.234496:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.234515:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.234527:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.234535:0:5953:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.234542:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.234550:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778933.234585:0:5953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790778933.234998:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+17:10354:x1877767510601344:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 888us (1313us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1790778933.235007:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000020:00080000:3.0:1790778933.235013:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790778933.235974:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778933.235988:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.235999:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778933.236004:0:6950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.236014:0:6950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.236040:0:6950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef227ba9400) 00010000:00010000:2.0:1790778933.236043:0:6950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790778933.236049:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.236053:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074e7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778933.236076:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778933.236078:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778933.236080:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778934.029141:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778934.283912:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778934.284024:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778934.285797:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531596032 00000100:00100000:1.0:1790778934.285814:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531596032 00000100:00080000:0.0:1790778934.285939:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778934.285955:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790778934.285968:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531596032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778934.286013:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125952 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1790778934.286429:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531596032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 464us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778934.286438:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790778934.286723:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778934.288764:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778934.288791:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531596160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778934.288872:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778934.289024:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531596160 00000100:00100000:0.0:1790778934.289035:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531596160 00000100:00100000:0.0:1790778934.289120:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790778934.289132:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3441:x1877767531596160:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790778934.289164:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1790778934.289167:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778934.289227:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3441:x1877767531596160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778934.289235:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790778934.289655:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531596160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790778935.063795:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790778935.080382:0:12438:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790778935.080392:0:12438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790778935.080430:0:12438:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790778935.080438:0:12438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1790778935.331770:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1790778935.331791:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1790778935.335267:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778935.335479:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510601600 00000100:00100000:1.0:1790778935.335490:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510601600 00000100:00080000:2.0:1790778935.335549:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778935.335555:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:1.0:1790778935.335566:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+17:10372:x1877767510601600:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778935.335595:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778935.335615:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074e85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccc1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.335748:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.335763:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.335776:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778935.335787:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790778935.335890:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc1 expref: 20 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.335910:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc1 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.335935:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778935.335938:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778935.335942:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387e00, rc 0) 00000100:00100000:1.0:1790778935.336024:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+19:10372:x1877767510601600:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 461us (766us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790778935.336031:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:2.0:1790778935.343809:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.343893:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510601728 00000100:00100000:3.0:1790778935.343903:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510601728 00000100:00100000:3.0:1790778935.343958:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1790778935.343968:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:10372:x1877767510601728:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1790778935.344045:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344064:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344075:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344105:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344112:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344119:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344202:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344210:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344216:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790778935.344274:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344286:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344293:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344299:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344306:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.344310:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344324:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344337:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778935.344340:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.344345:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344350:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074e9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344363:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344368:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344373:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344378:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.344380:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344385:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344392:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.344394:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.344396:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344410:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344425:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344431:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344436:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344461:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.344464:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344471:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344478:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9300) 00010000:00010000:3.0:1790778935.344481:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.344484:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.344490:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778935.344569:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:10372:x1877767510601728:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 602us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778935.344577:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:2.0:1790778935.411206:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.411309:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510601984 00000100:00100000:3.0:1790778935.411325:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510601984 00000100:00100000:3.0:1790778935.411394:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:3.0:1790778935.411406:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:10375:x1877767510601984:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778935.411429:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778935.411491:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074eaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccc8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411565:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411582:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411592:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411607:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411614:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411620:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411745:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411755:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411780:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778935.411791:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790778935.411868:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411876:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411883:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411889:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.411895:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411903:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411915:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778935.411918:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.411923:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411929:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411943:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411948:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411962:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411968:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.411971:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411977:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411986:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9300) 00010000:00010000:3.0:1790778935.411989:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.411992:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.411997:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.412037:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 22 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.412051:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.412059:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.412061:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778935.412063:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa200, rc 0) 00000100:00100000:3.0:1790778935.412128:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:10375:x1877767510601984:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 724us (930us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1790778935.412145:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:0.0:1790778935.421371:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.421499:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510602112 00000100:00100000:3.0:1790778935.421509:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510602112 00000100:00100000:3.0:1790778935.421565:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1790778935.421575:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:10375:x1877767510602112:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1790778935.421646:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421665:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421675:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421732:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421741:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421748:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421755:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.421759:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421767:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421779:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.421797:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778935.421803:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.421810:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778935.421884:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:10375:x1877767510602112:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 310us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778935.421892:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:2.0:1790778935.425177:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.426095:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510602368 00000100:00100000:3.0:1790778935.426107:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510602368 00000100:00100000:3.0:1790778935.426173:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1790778935.426185:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:10375:x1877767510602368:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778935.426877:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+22:10375:x1877767510602368:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 692us (1710us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790778935.426886:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:2.0:1790778935.480308:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778935.480631:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510602624 00000100:00100000:1.0:1790778935.480642:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510602624 00000100:00100000:1.0:1790778935.480728:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:1.0:1790778935.480738:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+22:9895:x1877767510602624:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778935.480764:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778935.480787:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074ed9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcccf expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.480919:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.480935:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.480946:0:5951:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.480993:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.481008:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 23 pid: 5949 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778935.481030:0:5951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531596288:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778935.481157:0:5951:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20555cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778935.488397:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778935.490021:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510602752 00000100:00100000:2.0:1790778935.490035:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510602752 00010000:00010000:2.0:1790778935.490082:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 24 pid: 5949 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778935.490141:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:2.0:1790778935.490152:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+24:2346:x1877767510602752:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778935.490167:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778935.490173:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 24 pid: 5949 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.490186:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 24 pid: 5949 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.490209:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778935.490214:0:5933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.490225:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.490242:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.490262:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778935.490360:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+24:2346:x1877767510602752:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 209us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778935.490368:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00010000:00010000:1.0:1790778935.491064:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc87632656074ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc8 expref: 23 pid: 5949 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778935.491083:0:5951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531596288:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778935.491119:0:5951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.491129:0:5951:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.491135:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778935.491154:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790778935.491310:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656074ed9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 24 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.491328:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 23 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778935.491337:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778935.491341:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778935.491343:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386c00, rc 0) 00000100:00100000:1.0:1790778935.491387:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+23:9895:x1877767510602624:12345-192.168.202.2@tcp:101:bash.0 Request processed in 10650us (11098us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1790778935.491410:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:0.0:1790778935.495211:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778935.495362:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510602880 00000100:00100000:2.0:1790778935.495374:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510602880 00000100:00100000:2.0:1790778935.495431:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:2.0:1790778935.495475:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+23:9895:x1877767510602880:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778935.495511:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778935.495534:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074eee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccd6 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.495572:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.495587:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.495597:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.495736:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656074eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccd6 expref: 25 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.495758:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccd6 expref: 24 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.495769:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778935.495772:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790778935.495776:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5200, rc 0) 00000100:00100000:2.0:1790778935.495865:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+24:9895:x1877767510602880:12345-192.168.202.2@tcp:101:bash.0 Request processed in 424us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778935.495872:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:2.0:1790778935.503714:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.505783:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510603136 00000100:00100000:3.0:1790778935.505810:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510603136 00000100:00100000:3.0:1790778935.505918:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1790778935.505931:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+24:9895:x1877767510603136:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:3.0:1790778935.506333:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.506358:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.506376:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778935.506527:0:5949:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1790778935.506556:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004562f357 reply state 00000000631fd970 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778935.506566:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790778935.506609:0:5949:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1790778935.506775:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:9895:x1877767510603136:12345-192.168.202.2@tcp:36:bash.0 Request processed in 846us (3076us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1790778935.506785:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000020:00080000:3.0:1790778935.506792:0:5949:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1790778935.514103:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.514131:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.514140:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.514148:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.514155:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.514165:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.514187:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.514191:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.514198:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778935.514355:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778935.514796:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510603264 00000100:00100000:0.0:1790778935.514808:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510603264 00000100:00100000:0.0:1790778935.514884:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1790778935.514898:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:9895:x1877767510603264:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778935.514930:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778935.514952:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074f03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccdd expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.515019:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074efc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.515019:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccdd expref: 29 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.515067:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccdd expref: 29 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.515091:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778935.515095:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790778935.515101:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0e00, rc 0) 00000100:00100000:0.0:1790778935.515167:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:9895:x1877767510603264:12345-192.168.202.2@tcp:101:bash.0 Request processed in 273us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778935.515174:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1790778935.518828:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.524420:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510603392 00000100:00100000:3.0:1790778935.524468:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510603392 00000100:00100000:0.0:1790778935.524748:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00080000:2.0:1790778935.524751:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778935.524766:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:9895:x1877767510603392:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778935.524790:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778935.524854:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcce4 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790778935.524882:0:6934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd1e33, atime: 0x6abd1e31, ctime: 0x6abd1e33, blocks: 0x8 00010000:00010000:0.0:1790778935.524906:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1790778935.524911:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778935.524921:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.524941:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.524954:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0800, rc 0) 00000100:00100000:0.0:1790778935.525028:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:9895:x1877767510603392:12345-192.168.202.2@tcp:101:bash.0 Request processed in 268us (6208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778935.525035:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1790778935.536682:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778935.537052:0:6940:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510603520 00000100:00100000:1.0:1790778935.537064:0:6940:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510603520 00002000:00010000:1.0:1790778935.537110:0:6940:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1790778935.537116:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236845f80 with x1877767510603520 ext(0->18446744073709551615) 00002000:00010000:1.0:1790778935.537127:0:6940:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236845f80. 00000100:00100000:1.0:1790778935.537197:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1790778935.537207:0:6940:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510603520:12345-192.168.202.2@tcp:10:bash.0 00002000:00010000:1.0:1790778935.537513:0:6940:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790778935.537517:0:6940:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790778931 -> 1790778935 00002000:00010000:1.0:1790778935.537519:0:6940:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790778929 -> 1790778929 00002000:00010000:1.0:1790778935.537522:0:6940:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790778931 -> 1790778935 00002000:00010000:1.0:1790778935.537524:0:6940:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1790778935.537651:0:6940:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510603520:12345-192.168.202.2@tcp:10:bash.0 Request processed in 444us (978us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790778935.537659:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00002000:00010000:1.0:1790778935.537663:0:6940:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1790778935.537666:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236845f80 with x1877767510603520 ext(0->18446744073709551615) 00002000:00010000:1.0:1790778935.537670:0:6940:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236845f80. 00000100:00100000:2.0:1790778935.641201:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.641374:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510603648 00000100:00100000:3.0:1790778935.641385:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510603648 00000100:00100000:3.0:1790778935.641488:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:3.0:1790778935.641499:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:10389:x1877767510603648:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1790778935.641583:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641602:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641614:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641630:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641637:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641644:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641726:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641757:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641766:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790778935.641818:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641830:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641838:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641857:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641864:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.641868:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641877:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.641889:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778935.641893:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.641897:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642015:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642040:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642047:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642053:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642059:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.642062:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642069:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642077:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9300) 00010000:00010000:3.0:1790778935.642080:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.642083:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642100:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642116:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642123:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642129:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642139:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.642143:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642149:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642157:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.642160:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.642163:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.642168:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778935.642244:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:10389:x1877767510603648:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 746us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778935.642252:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:0.0:1790778935.709065:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778935.711585:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510603904 00000100:00100000:2.0:1790778935.711602:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510603904 00000100:00100000:2.0:1790778935.711675:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1790778935.711687:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:10392:x1877767510603904:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778935.711722:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778935.711748:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656074f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcceb expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.711844:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.711871:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.711882:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.711900:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.711915:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.711922:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712535:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712546:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712555:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778935.712578:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790778935.712731:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712741:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712749:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712755:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778935.712760:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712769:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712782:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778935.712785:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778935.712791:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.712807:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713320:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713327:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713333:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713342:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778935.713346:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713352:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713361:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef2363a9a00) 00010000:00010000:2.0:1790778935.713363:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778935.713366:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713372:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656074f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713761:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656074f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcceb expref: 31 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713776:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcceb expref: 30 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.713794:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778935.713796:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790778935.713799:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4400, rc 0) 00000100:00100000:2.0:1790778935.713890:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+30:10392:x1877767510603904:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 2205us (4836us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1790778935.713900:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1790778935.720279:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.720360:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510604032 00000100:00100000:3.0:1790778935.720370:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510604032 00000100:00100000:3.0:1790778935.720430:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:3.0:1790778935.720471:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:10392:x1877767510604032:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1790778935.720549:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.720569:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 30 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.720578:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.720626:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 30 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.720641:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 30 pid: 5951 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778935.720657:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236845500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531596416:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778935.720772:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef210134480 going to sleep for 11 seconds 00000100:00100000:0.0:1790778935.728005:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.728370:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236845500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531596416:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778935.728396:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778935.728516:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510604288 00000100:00100000:1.0:1790778935.728524:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510604288 00000100:00100000:1.0:1790778935.728577:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1790778935.728587:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:9033:x1877767510604288:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790778935.729120:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+32:9033:x1877767510604288:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 533us (1127us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790778935.729144:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1790778935.732798:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778935.733129:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510604416 00000100:00100000:0.0:1790778935.733139:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510604416 00010000:00010000:0.0:1790778935.733178:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 32 pid: 5951 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778935.733266:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1790778935.733284:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+32:2345:x1877767510604416:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778935.733298:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778935.733305:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 32 pid: 5951 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.733343:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 32 pid: 5951 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.733365:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656074ee0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcccf expref: 32 pid: 5951 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.733382:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778935.733387:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.733396:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.733403:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778935.733433:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778935.733512:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+31:2345:x1877767510604416:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 230us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778935.733519:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00010000:00010000:2.0:1790778935.734805:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.734819:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.734869:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.734877:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.734885:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.734891:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778935.734895:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.735027:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.735059:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778935.735062:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778935.735066:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.735074:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656074f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778935.735159:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:10392:x1877767510604032:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 14717us (14896us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778935.735167:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:1.0:1790778935.739881:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.740043:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510604672 00000100:00100000:3.0:1790778935.740056:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510604672 00000100:00100000:3.0:1790778935.740114:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1790778935.740125:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+30:10392:x1877767510604672:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778935.740407:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+31:10392:x1877767510604672:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 284us (535us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790778935.740415:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:1.0:1790778935.915816:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.915919:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510604928 00000100:00100000:3.0:1790778935.915930:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510604928 00000100:00100000:3.0:1790778935.915989:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:3.0:1790778935.916000:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+31:10403:x1877767510604928:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1790778935.916039:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778935.916061:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccf2 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916174:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916191:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916204:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916217:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916223:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916230:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916337:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916347:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916354:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778935.916363:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790778935.916433:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916496:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916510:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916517:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.916521:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916528:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916540:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778935.916544:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.916548:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916553:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916567:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916572:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916577:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916582:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.916584:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916599:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916607:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9300) 00010000:00010000:3.0:1790778935.916609:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.916612:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916619:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916656:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf2 expref: 34 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916668:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf2 expref: 33 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.916676:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.916678:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778935.916681:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778935.916757:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:10403:x1877767510604928:12345-192.168.202.2@tcp:101:cat.0 Request processed in 760us (952us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790778935.916764:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:0.0:1790778935.924956:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.925178:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510605184 00000100:00100000:3.0:1790778935.925188:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510605184 00000100:00100000:3.0:1790778935.925246:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1790778935.925257:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:10403:x1877767510605184:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:3.0:1790778935.925582:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+34:10403:x1877767510605184:12345-192.168.202.2@tcp:35:cat.0 Request processed in 326us (633us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790778935.925590:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1790778935.957317:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778935.957531:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510605440 00000100:00100000:3.0:1790778935.957542:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510605440 00000100:00100000:3.0:1790778935.957609:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:3.0:1790778935.957620:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+34:10404:x1877767510605440:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:3.0:1790778935.957705:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1790778935.957736:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656074f03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccdd expref: 34 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957762:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074f65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf2 expref: 33 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957778:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc87632656074f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcceb expref: 32 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957792:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656074ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccd6 expref: 31 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957803:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778935.957815:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778935.957839:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957854:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957880:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957897:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957906:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957913:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957989:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.957997:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958005:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790778935.958407:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1790778935.958418:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329833975308ns, next at 330833972231ns, rc = 0 00010000:00010000:3.0:1790778935.958704:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958715:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958723:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958745:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958752:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958759:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958781:0:5951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790778935.958808:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958814:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958822:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958828:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.958833:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958840:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958852:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9d00) 00010000:00010000:3.0:1790778935.958855:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790778935.958860:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958877:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656074f81 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958896:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958902:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958908:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958913:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778935.958916:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958922:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958929:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778935.958931:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778935.958934:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778935.958940:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074f73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790778935.958950:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000080a15b72 reply state 0000000062508955 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778935.958960:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790778935.959199:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+32:10404:x1877767510605440:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1578us (1898us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790778935.959207:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00010000:00010000:2.0:1790778935.959475:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778935.959483:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.959491:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778935.959494:0:6950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.959501:0:6950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.959509:0:6950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef227ba9d00) 00010000:00010000:2.0:1790778935.959512:0:6950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790778935.959515:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.959521:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656074f88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.959548:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778935.959550:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778935.959552:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778935.968473:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.968490:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.968497:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.968503:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778935.968508:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.968516:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.968533:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9300) 00010000:00010000:2.0:1790778935.968536:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778935.968541:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778935.968546:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656074f7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778936.014090:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.014244:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510605696 00000100:00100000:2.0:1790778936.014256:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510605696 00000100:00100000:2.0:1790778936.014330:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:2.0:1790778936.014340:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+31:10410:x1877767510605696:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778936.014380:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778936.014402:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dccf9 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.014567:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.014585:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.014597:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.014613:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.014621:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.014627:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790778936.014990:0:7119:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790778936.015140:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015149:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015156:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015198:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015205:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015211:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015217:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778936.015221:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015228:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015238:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778936.015241:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778936.015245:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015251:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074f96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790778936.015261:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d4ef23f reply state 000000006a4ef80b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.015269:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790778936.015293:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074f8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 34 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015317:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 33 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.015324:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:2.0:1790778936.015327:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778936.015329:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4600, rc 0) 00000100:00100000:2.0:1790778936.015392:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+34:10410:x1877767510605696:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1053us (1322us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1790778936.015399:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00010000:00010000:3.0:1790778936.017821:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.017838:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.017845:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.017852:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.017857:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.017865:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.017879:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef2363a9a00) 00010000:00010000:3.0:1790778936.017882:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778936.017886:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.017892:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778936.021105:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.021179:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510605824 00000100:00100000:3.0:1790778936.021190:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510605824 00000100:00100000:3.0:1790778936.021261:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1790778936.021271:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510605824:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790778936.021305:0:6935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778936.021335:0:6935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd00 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778936.021359:0:6935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790778936.021376:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1790778936.021380:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778936.021390:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 6 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.021407:0:6935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 6 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.021420:0:6935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:3.0:1790778936.021502:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510605824:12345-192.168.202.2@tcp:101:bash.0 Request processed in 232us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778936.021509:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00080000:2.0:1790778936.021679:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778936.025546:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.025625:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510605952 00000100:00100000:3.0:1790778936.025636:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510605952 00000100:00100000:3.0:1790778936.025688:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1790778936.025706:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:10410:x1877767510605952:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790778936.025724:0:12307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778936.025741:0:12307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd07 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.025771:0:12307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 7 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.025792:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778936.025796:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778936.025802:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 7 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.025835:0:12307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 7 pid: 6935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.025848:0:12307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 7 pid: 6935 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.025864:0:12307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236845500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12307:1877767531596544:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778936.025971:0:12307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef210134480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778936.029798:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.029897:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510606080 00000100:00100000:2.0:1790778936.029907:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510606080 00010000:00010000:2.0:1790778936.029948:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 8 pid: 6935 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.029995:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1790778936.030005:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510606080:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778936.030020:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778936.030055:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 8 pid: 6935 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.030068:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 8 pid: 6935 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.030091:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778936.030121:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778936.030130:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.030140:0:5933:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.030174:0:5933:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.030188:0:5933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236864000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5933:1877767531596672:192.168.202.2@tcp:105: 00000100:00100000:2.0:1790778936.030266:0:5933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03600 going to sleep for 11 seconds 00010000:00010000:3.0:1790778936.030822:0:12307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53f0c9b/0xdc87632656074fb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd00 expref: 8 pid: 6935 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.030839:0:12307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236845500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12307:1877767531596544:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778936.030869:0:12307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 7 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.030880:0:12307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:3.0:1790778936.030922:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:10410:x1877767510605952:12345-192.168.202.2@tcp:101:bash.0 Request processed in 5217us (5384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778936.030939:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1790778936.035523:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.035663:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510606336 00000100:00100000:3.0:1790778936.035673:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510606336 00000100:00100000:3.0:1790778936.035744:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1790778936.035755:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:10410:x1877767510606336:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1790778936.036307:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+34:10410:x1877767510606336:12345-192.168.202.2@tcp:35:bash.0 Request processed in 552us (792us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1790778936.036315:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1790778936.036801:0:5933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236864000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5933:1877767531596672:192.168.202.2@tcp:105: 00010000:00010000:2.0:1790778936.036821:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778936.036856:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510606080:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 6853us (7070us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.036865:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00010000:00010000:1.0:1790778936.075718:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778936.146531:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778936.146581:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.146682:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510606592 00000100:00100000:2.0:1790778936.146727:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510606592 00000100:00100000:2.0:1790778936.146830:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:2.0:1790778936.146842:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2344:x1877767510606592:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778936.146951:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:2344:x1877767510606592:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 111us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.146960:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:0.0:1790778936.147253:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510606464 00000100:00100000:0.0:1790778936.147258:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510606464 00000100:00100000:0.0:1790778936.147298:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 289 00000100:00100000:0.0:1790778936.147315:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510606464:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778936.147345:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2344:x1877767510606464:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.147371:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 289 00000100:00080000:1.0:1790778936.147866:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778936.197488:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.199093:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510606720 00000100:00100000:2.0:1790778936.199109:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510606720 00000100:00100000:2.0:1790778936.199201:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1790778936.199212:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+34:10426:x1877767510606720:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778936.199237:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778936.199257:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd0e expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.199323:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074fc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.199338:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.199350:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778936.199393:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790778936.199396:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778936.199413:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.199436:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd0e expref: 36 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.199761:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd0e expref: 35 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.199771:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778936.199774:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790778936.199778:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5600, rc 0) 00000100:00100000:0.0:1790778936.201234:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+35:10426:x1877767510606720:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 2015us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.201245:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1790778936.209709:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.209790:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510606976 00000100:00100000:2.0:1790778936.209815:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510606976 00000100:00100000:2.0:1790778936.209881:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:2.0:1790778936.209890:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:10426:x1877767510606976:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778936.209914:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778936.209938:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074fce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd15 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.210060:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074fd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.210075:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.210100:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778936.210115:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790778936.210239:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656074fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd15 expref: 38 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.210260:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd15 expref: 37 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.210269:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:2.0:1790778936.210273:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778936.210276:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5e00, rc 0) 00000100:00100000:2.0:1790778936.210353:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+37:10426:x1877767510606976:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 463us (667us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1790778936.210360:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:1.0:1790778936.216246:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.217026:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510607360 00000100:00100000:3.0:1790778936.217043:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510607360 00000100:00100000:3.0:1790778936.217115:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:3.0:1790778936.217125:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+37:10426:x1877767510607360:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778936.217155:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778936.217177:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd1c expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.217284:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074fea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.217298:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.217314:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778936.217326:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790778936.217485:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd1c expref: 40 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.217504:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd1c expref: 39 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.217511:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:3.0:1790778936.217514:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790778936.217516:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778936.217568:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+39:10426:x1877767510607360:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 447us (1333us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1790778936.217573:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:1.0:1790778936.220043:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.220370:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510607232 00000100:00100000:3.0:1790778936.220382:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510607232 00000100:00100000:3.0:1790778936.220463:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1790778936.220472:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+39:2345:x1877767510607232:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778936.220486:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778936.220512:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656074fd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd15 expref: 39 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.220531:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:3.0:1790778936.220536:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778936.220584:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+38:2345:x1877767510607232:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 115us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778936.220590:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1790778936.225283:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.225519:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510607488 00000100:00100000:3.0:1790778936.225528:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510607488 00000100:00100000:3.0:1790778936.225592:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:3.0:1790778936.225600:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510607488:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:3.0:1790778936.225644:0:6935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.225661:0:6935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 6 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.225667:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790778936.225671:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790778936.225674:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.225723:0:6935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 6 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.225737:0:6935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 6 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.225753:0:6935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6935:1877767531596800:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778936.225958:0:6935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef210134480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778936.230023:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.230121:0:6935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6935:1877767531596800:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778936.230148:0:6935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778936.230951:0:6942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510607616 00000100:00100000:0.0:1790778936.230961:0:6942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510607616 00002000:00100000:0.0:1790778936.231021:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ef23684ca80 x1877767510607616/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:487/0 lens 504/0 e 0 to 0 dl 1790778947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790778936.231032:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef23684ca80 with x1877767510607616 ext(0->8) 00010000:00010000:0.0:1790778936.231040:0:6942:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 7 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.231054:0:6942:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 7 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790778936.231063:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef23684ca80 00000100:00100000:0.0:1790778936.231216:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1790778936.231227:0:6942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510607616:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:0.0:1790778936.232778:0:6942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2346:x1877767510607616:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 1544us (2757us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790778936.232791:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00002000:00100000:0.0:1790778936.232802:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ef23684ca80 x1877767510607616/t4294967302(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:487/0 lens 504/448 e 0 to 0 dl 1790778947 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790778936.232830:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef23684ca80 with x1877767510607616 ext(0->8) 00010000:00010000:0.0:1790778936.232839:0:6942:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 9 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.232856:0:6942:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 9 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790778936.232864:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef23684ca80 00000100:00100000:1.0:1790778936.236419:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778936.236585:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510607744 00000100:00100000:0.0:1790778936.236595:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510607744 00010000:00010000:0.0:1790778936.236636:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 9 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778936.236721:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1790778936.236731:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510607744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778936.236746:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790778936.236765:0:12059:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790778936.236768:0:12059:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790778936 00002000:00010000:0.0:1790778936.236770:0:12059:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790778936 00002000:00010000:0.0:1790778936.236772:0:12059:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790778936 00002000:00010000:0.0:1790778936.236774:0:12059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1790778936.236779:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 9 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.236792:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 9 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.236826:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067e1b5ac/0xdc87632656074fb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd07 expref: 9 pid: 12307 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.236844:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778936.236849:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778936.236854:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.236865:0:12059:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.236896:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778936.236950:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510607744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 221us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.236958:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00010000:00010000:3.0:1790778936.237140:0:6935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237156:0:6935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237175:0:6935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237183:0:6935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237191:0:6935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237198:0:6935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aac00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778936.237202:0:6935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237210:0:6935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237222:0:6935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.237229:0:6935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079848799/0xdc87632656074ff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.237298:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:2344:x1877767510607488:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 11699us (12028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778936.237314:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1790778936.242050:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.242134:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510608000 00000100:00100000:3.0:1790778936.242144:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510608000 00000100:00100000:3.0:1790778936.242196:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1790778936.242206:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+38:10426:x1877767510608000:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1790778936.242278:0:5952:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd1c expref: 38 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778936.242548:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1790778936.242578:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1790778936.243120:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1790778936.243161:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.243177:0:5952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 42 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.243187:0:5952:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.243226:0:5952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 42 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.243246:0:5952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 42 pid: 7119 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.243279:0:5952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236846680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5952:1877767531596928:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778936.243421:0:5952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef210134480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778936.248270:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.248489:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510608128 00000100:00100000:2.0:1790778936.248498:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510608128 00010000:00010000:2.0:1790778936.248540:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 43 pid: 7119 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.248576:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1790778936.248586:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+43:2346:x1877767510608128:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778936.248602:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778936.248608:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 43 pid: 7119 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.248620:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 43 pid: 7119 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.248641:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:2.0:1790778936.248646:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.248655:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.248662:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.248680:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778936.248737:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+43:2346:x1877767510608128:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 153us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.248745:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00010000:00010000:3.0:1790778936.249551:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656074fa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccf9 expref: 42 pid: 7119 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.249569:0:5952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236846680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5952:1877767531596928:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778936.249590:0:5952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.249599:0:5952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.249604:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778936.249737:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790778936.249877:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1790778936.249962:0:5952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236846680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531597056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790778936.250014:0:5952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778936.250051:0:5952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206382780 going to sleep for 11 seconds 00000100:00100000:1.0:1790778936.250924:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531597056 00000100:00100000:1.0:1790778936.250934:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531597056 00000100:00100000:1.0:1790778936.251526:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790778936.251536:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5952:x1877767531597056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790778936.251660:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5952:x1877767531597056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 126us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778936.251682:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790778936.251798:0:5952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1790778936.251805:0:5952:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1790778936.251825:0:5952:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef2366c9c00, transno 4294967301 00000100:00100000:0.0:1790778936.251857:0:5952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236846680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531597056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790778936.251999:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790778936.252067:0:5952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531597184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790778936.252101:0:5952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778936.252127:0:5952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2101346c0 going to sleep for 11 seconds 00000100:00080000:2.0:1790778936.252312:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778936.252715:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531597184 00000100:00100000:3.0:1790778936.252723:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531597184 00000100:00100000:2.0:1790778936.252890:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790778936.252900:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5952:x1877767531597184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790778936.253047:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5952:x1877767531597184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 147us (945us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790778936.253055:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790778936.253132:0:5952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531597184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790778936.253190:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1790778936.253228:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.253238:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.253245:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.253251:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778936.253255:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.253262:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.253277:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:0.0:1790778936.253280:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790778936.253285:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.253292:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656074fff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790778936.253394:0:5952:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790778936.253465:0:5952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1790778936.253477:0:5952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330129034343ns, next at 331129032314ns, rc = 0 00000001:00080000:0.0:1790778936.253484:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1790778936.253505:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef2363a9200) 00010000:00010000:0.0:1790778936.253509:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790778936.253521:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656074fea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd1c expref: 46 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778936.253614:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+45:10426:x1877767510608000:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 11409us (11572us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1790778936.253622:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000020:00080000:0.0:1790778936.253625:0:5952:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790778936.259258:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.259537:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510608256 00000100:00100000:2.0:1790778936.259548:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510608256 00000100:00100000:3.0:1790778936.259611:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:3.0:1790778936.259625:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+45:10426:x1877767510608256:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778936.259653:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778936.259679:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd23 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.259768:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd23 expref: 46 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.259783:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd23 expref: 46 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.259800:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778936.259803:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790778936.259807:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aac00, rc 0) 00000100:00100000:3.0:1790778936.259856:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+46:10426:x1877767510608256:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 236us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778936.259863:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:1.0:1790778936.268933:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.269188:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510608512 00000100:00100000:3.0:1790778936.269199:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510608512 00000100:00100000:3.0:1790778936.269258:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1790778936.269269:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+46:10426:x1877767510608512:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778936.269591:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+47:10426:x1877767510608512:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 321us (667us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1790778936.269600:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:1.0:1790778936.446294:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.446436:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510608640 00000100:00100000:3.0:1790778936.446484:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510608640 00000100:00100000:3.0:1790778936.446546:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:3.0:1790778936.446557:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+47:10436:x1877767510608640:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1790778936.446647:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.446683:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.446868:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.446904:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.446914:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.446920:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.446992:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447001:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447009:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790778936.447057:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447071:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447078:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447086:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447101:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.447106:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447113:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447125:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778936.447128:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778936.447132:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447137:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607500d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447152:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447158:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447164:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447168:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.447171:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447177:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447194:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9800) 00010000:00010000:3.0:1790778936.447197:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778936.447200:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447205:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447220:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447227:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447232:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447237:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.447240:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447247:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447255:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778936.447257:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778936.447260:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.447266:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607501b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.447899:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+47:10436:x1877767510608640:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1341us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778936.447910:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:1.0:1790778936.507510:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.507598:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510608896 00000100:00100000:3.0:1790778936.507608:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510608896 00000100:00100000:3.0:1790778936.507671:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:3.0:1790778936.507682:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+47:10439:x1877767510608896:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778936.507732:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778936.507753:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd2a expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.507834:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.507849:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.507861:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.507877:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.507885:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.507892:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508023:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508032:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508039:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778936.508048:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790778936.508208:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508216:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508222:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508227:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.508231:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508242:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508253:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778936.508256:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778936.508260:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508275:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508288:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508293:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508299:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508312:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.508315:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508321:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508327:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9800) 00010000:00010000:3.0:1790778936.508329:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778936.508332:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508337:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508375:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 50 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508386:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 49 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.508396:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778936.508399:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778936.508401:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aae00, rc 0) 00000100:00100000:3.0:1790778936.508513:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+49:10439:x1877767510608896:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 832us (1012us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790778936.508520:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:2.0:1790778936.514139:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.514392:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510609024 00000100:00100000:3.0:1790778936.514402:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510609024 00000100:00100000:3.0:1790778936.514492:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:3.0:1790778936.514502:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+49:10439:x1877767510609024:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1790778936.514574:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514591:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514603:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514638:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514646:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514654:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514674:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778936.514847:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514855:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514866:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778936.514870:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778936.514875:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.514881:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.516072:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+49:10439:x1877767510609024:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 579us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.516092:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:0.0:1790778936.531761:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.531850:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510609280 00000100:00100000:3.0:1790778936.531863:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510609280 00000100:00100000:3.0:1790778936.531916:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1790778936.531927:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+49:10439:x1877767510609280:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778936.532192:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+50:10439:x1877767510609280:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 266us (442us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790778936.532200:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1790778936.623013:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.623203:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510609536 00000100:00100000:3.0:1790778936.623213:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510609536 00000100:00100000:3.0:1790778936.623275:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:3.0:1790778936.623285:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+50:10449:x1877767510609536:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790778936.623312:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778936.623316:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790778936.623341:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656074fc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd0e expref: 50 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.623378:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:3.0:1790778936.623383:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778936.623396:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607504c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd31 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.623570:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.623584:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 50 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.623593:0:5951:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.623623:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 50 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.623636:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 50 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.623650:0:5951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236847100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531597312:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778936.623762:0:5951:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778936.628928:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.629156:0:5951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236847100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531597312:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778936.629267:0:5951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778936.629576:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510609664 00000100:00100000:1.0:1790778936.629586:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510609664 00010000:00010000:1.0:1790778936.629637:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 51 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778936.629682:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1790778936.629705:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+51:2345:x1877767510609664:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778936.629722:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778936.629729:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 51 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.629743:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 51 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.629764:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd2a expref: 51 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.629782:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778936.629787:0:5933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.629818:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.629827:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.629848:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778936.630153:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+50:2345:x1877767510609664:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 449us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778936.630162:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00010000:00010000:3.0:1790778936.630788:0:5951:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.630808:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778936.630827:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790778936.630955:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607504c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 51 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.630972:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 50 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.630980:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778936.630984:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790778936.630987:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778936.631220:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+50:10449:x1877767510609536:12345-192.168.202.2@tcp:101:bash.0 Request processed in 7936us (8215us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1790778936.631229:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:2.0:1790778936.633788:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778936.634263:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510609792 00000100:00100000:0.0:1790778936.634274:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510609792 00000100:00100000:0.0:1790778936.634388:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1790778936.634398:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+50:10449:x1877767510609792:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778936.634424:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778936.634598:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd38 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.634635:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.634650:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.634817:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.634939:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 52 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.634962:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 51 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.634972:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778936.634975:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790778936.634978:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0600, rc 0) 00000100:00100000:0.0:1790778936.635088:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+51:10449:x1877767510609792:12345-192.168.202.2@tcp:101:bash.0 Request processed in 691us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.635095:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1790778936.644146:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.644794:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510610048 00000100:00100000:2.0:1790778936.644804:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510610048 00000100:00100000:2.0:1790778936.644858:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:2.0:1790778936.644868:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+51:10449:x1877767510610048:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:2.0:1790778936.645091:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.645108:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.645119:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778936.645156:0:5949:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1790778936.645175:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000045cc3b6 reply state 000000005edced04 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.645199:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778936.645281:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+54:10449:x1877767510610048:12345-192.168.202.2@tcp:36:bash.0 Request processed in 414us (1142us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790778936.645289:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000020:00080000:2.0:1790778936.645294:0:5949:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790778936.646692:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.646708:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.646716:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.646723:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778936.646728:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.646736:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.646749:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778936.646752:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778936.646766:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.646773:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607506f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778936.649002:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.649248:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510610176 00000100:00100000:2.0:1790778936.649260:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510610176 00000100:00100000:2.0:1790778936.649313:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:2.0:1790778936.649433:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+53:10449:x1877767510610176:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778936.649482:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778936.649504:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd3f expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.649638:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.649654:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 54 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.649665:0:5950:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.649712:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 54 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.649726:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 54 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.649756:0:5950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236864700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531597440:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778936.649853:0:5950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03600 going to sleep for 11 seconds 00000100:00100000:3.0:1790778936.654230:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.654345:0:5950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236864700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531597440:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778936.654371:0:5950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778936.654562:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510610304 00000100:00100000:0.0:1790778936.654571:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510610304 00010000:00010000:0.0:1790778936.654612:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 55 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778936.654641:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:0.0:1790778936.654649:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+55:2346:x1877767510610304:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778936.654666:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778936.654673:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 55 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.654698:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 55 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.654721:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd31 expref: 55 pid: 5951 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.654740:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778936.654745:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.654756:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.654778:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.654800:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778936.654853:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+54:2346:x1877767510610304:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 205us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.654860:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00010000:00010000:2.0:1790778936.654925:0:5950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.654933:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778936.654985:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790778936.654989:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778936.655007:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.655036:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 54 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.655049:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 53 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.655057:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778936.655060:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778936.655062:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5400, rc 0) 00000100:00100000:2.0:1790778936.655085:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+53:10449:x1877767510610176:12345-192.168.202.2@tcp:101:bash.0 Request processed in 5655us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.655097:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:1.0:1790778936.662149:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778936.662258:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510610560 00000100:00100000:3.0:1790778936.662268:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510610560 00000100:00100000:3.0:1790778936.662333:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1790778936.662342:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+53:10449:x1877767510610560:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1790778936.662597:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+54:10449:x1877767510610560:12345-192.168.202.2@tcp:35:bash.0 Request processed in 256us (457us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1790778936.662605:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1790778936.823195:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778936.823403:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510610688 00000100:00100000:1.0:1790778936.823415:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510610688 00000100:00100000:1.0:1790778936.823527:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:1.0:1790778936.823538:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+54:10455:x1877767510610688:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778936.823568:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778936.823591:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656075084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd46 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.823661:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607508b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.823696:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607508b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.823710:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607508b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778936.823902:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1790778936.823922:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778936.823948:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607508b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.823978:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc87632656075084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd46 expref: 56 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.823999:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607508b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd46 expref: 55 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.824009:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778936.824013:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778936.824017:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387600, rc 0) 00000100:00100000:1.0:1790778936.824092:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510610688:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 556us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778936.824099:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:1.0:1790778936.839553:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778936.842878:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510610816 00000100:00100000:0.0:1790778936.842895:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510610816 00000100:00100000:0.0:1790778936.842980:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:0.0:1790778936.842991:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510610816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778936.843015:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778936.843036:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd4d expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843102:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843117:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843128:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843142:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843149:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843173:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843282:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843291:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843298:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778936.843342:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790778936.843347:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778936.843367:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843378:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843387:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843394:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843403:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843409:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778936.843414:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843428:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843503:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:0.0:1790778936.843508:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778936.843514:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843522:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075099 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843537:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843544:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843550:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843556:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778936.843559:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843566:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843574:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef235cc0d00) 00010000:00010000:0.0:1790778936.843577:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778936.843579:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843596:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560750a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843628:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd4d expref: 57 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843641:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd4d expref: 56 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.843649:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778936.843652:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778936.843654:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:0.0:1790778936.843767:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+56:10455:x1877767510610816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 778us (4227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.843776:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:2.0:1790778936.853241:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778936.855672:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611200 00000100:00100000:0.0:1790778936.855698:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611200 00000100:00100000:0.0:1790778936.855779:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1790778936.855790:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+56:2346:x1877767510611200:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778936.855807:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778936.855835:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560750a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd4d expref: 56 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.855853:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778936.855858:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778936.855933:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+55:2346:x1877767510611200:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 144us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.855955:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1790778936.861574:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.861818:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611072 00000100:00100000:2.0:1790778936.861826:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611072 00000100:00100000:2.0:1790778936.861874:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:2.0:1790778936.861885:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510611072:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778936.861907:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778936.862078:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd54 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.862183:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.862198:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 56 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.862207:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.862241:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 56 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.862255:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 56 pid: 5950 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.862268:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236864700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531597568:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778936.862377:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03600 going to sleep for 11 seconds 00000100:00100000:2.0:1790778936.867771:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236864700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531597568:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778936.868226:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778936.869219:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778936.869550:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611328 00000100:00100000:0.0:1790778936.869560:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611328 00010000:00010000:2.0:1790778936.869692:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 57 pid: 5950 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778936.869779:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1790778936.869920:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+57:2345:x1877767510611328:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778936.869937:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778936.869944:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 57 pid: 5950 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.869958:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 57 pid: 5950 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.869980:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc8763265607507d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd3f expref: 57 pid: 5950 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.869996:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778936.870002:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.870013:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.870021:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.870071:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778936.870140:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+56:2345:x1877767510611328:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 352us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.870148:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00010000:00010000:3.0:1790778936.870840:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.870851:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778936.870873:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790778936.871004:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 57 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.871021:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 56 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778936.871029:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778936.871032:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790778936.871035:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4000, rc 0) 00000100:00100000:3.0:1790778936.871092:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+56:10455:x1877767510611072:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 9210us (9530us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790778936.871101:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:3.0:1790778936.883488:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778936.883856:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611584 00000100:00100000:0.0:1790778936.883867:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611584 00000100:00100000:0.0:1790778936.884158:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790778936.884171:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+56:10455:x1877767510611584:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:0.0:1790778936.884187:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778936.884213:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd23 expref: 56 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778936.884236:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778936.884241:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778936.885128:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510611584:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 956us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778936.885138:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790778936.900888:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778936.901047:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611712 00000100:00100000:2.0:1790778936.901058:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611712 00000100:00100000:2.0:1790778936.901185:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1790778936.901198:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510611712:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:2.0:1790778936.903043:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.903545:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778936.903561:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790778936.903662:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790778936.905109:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510611712:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 3905us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778936.905122:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1790778936.909399:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778936.913050:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611840 00000100:00100000:1.0:1790778936.913067:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611840 00000100:00100000:1.0:1790778936.913224:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1790778936.913236:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+55:10455:x1877767510611840:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778936.913259:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778936.913290:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd5b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.913350:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.913362:0:5951:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 56 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.913397:0:5951:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.913411:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 56 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.913426:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778936.913429:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790778936.913433:0:5951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 56 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778936.913458:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386c00, rc 0) 00000100:00100000:1.0:1790778936.913532:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+56:10455:x1877767510611840:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 299us (4257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778936.913540:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00010000:00010000:2.0:1790778937.100465:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790778937.355743:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790778937.355753:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790778937.355788:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1790778937.355797:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790778937.355935:0:12077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531597696:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790778937.356050:0:12077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20555cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790778937.356312:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531597824:0@lo:400:kworker.0 00000100:00100000:2.0:1790778937.356363:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778937.356482:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531597824 00000100:00100000:1.0:1790778937.356491:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531597824 00000100:00100000:1.0:1790778937.356588:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790778937.356597:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531597824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.358367:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531597952:0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.358404:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778937.358451:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531597952 00000100:00100000:3.0:1790778937.358456:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531597952 00000100:00100000:3.0:1790778937.358486:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790778937.358492:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531597952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.358523:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531597952:12345-0@lo:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.358538:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790778937.358568:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531597952:0@lo:400:kworker.0 00000100:00100000:0.0:1790778937.362492:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531598208:0@lo:400:kworker.0 00000100:00100000:0.0:1790778937.362560:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.362600:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778937.362606:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531598080:0@lo:400:kworker.0 00000100:00100000:0.0:1790778937.362632:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.362662:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531598208 00000100:00100000:0.0:1790778937.362670:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531598208 00000100:00080000:0.0:1790778937.362709:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778937.362747:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790778937.362757:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531598208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778937.362822:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531598208:12345-0@lo:400:kworker.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778937.362830:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790778937.362837:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531598464:0@lo:400:kworker.0 00000100:00100000:0.0:1790778937.363433:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531598208:0@lo:400:kworker.0 00000100:00100000:0.0:1790778937.363508:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531598080 00000100:00100000:0.0:1790778937.363513:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531598080 00000100:00080000:0.0:1790778937.363530:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778937.363558:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790778937.363565:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531598080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778937.369502:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531597824:0@lo:400:kworker.0 00000100:00100000:2.0:1790778937.369548:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531598336:0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.370811:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.370830:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531598080:12345-0@lo:400:kworker.0 Request processed in 7263us (8195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778937.370843:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790778937.370871:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531598464 00000100:00100000:3.0:1790778937.370878:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531598464 00000100:00100000:3.0:1790778937.370930:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790778937.370940:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3440:x1877767531598464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.371005:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3440:x1877767531598464:12345-0@lo:400:kworker.0 Request processed in 66us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.371011:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790778937.371051:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531598464:0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.371125:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.371138:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510611968 00000100:00100000:3.0:1790778937.371141:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510611968 00000100:00080000:3.0:1790778937.371160:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778937.371182:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:3.0:1790778937.371188:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510611968:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790778937.371211:0:5950:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790778937.371342:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510611968:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 153us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.371348:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:1.0:1790778937.374130:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531597824:12345-0@lo:400:kworker.0 Request processed in 17521us (17754us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.374162:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790778937.374261:0:12077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531597696:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790778937.377012:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.377721:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531598080:0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.377832:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531598336 00000100:00100000:3.0:1790778937.377841:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531598336 00000100:00100000:3.0:1790778937.378159:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790778937.378186:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531598336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778937.378266:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531598336:12345-0@lo:400:kworker.0 Request processed in 81us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.378283:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790778937.378285:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531598336:0@lo:400:kworker.0 00000100:00080000:0.0:1790778937.380076:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778937.380618:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.381269:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510612096 00000100:00100000:1.0:1790778937.381357:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510612096 00000100:00100000:3.0:1790778937.391624:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:2.0:1790778937.391708:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+56:10456:x1877767510612096:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790778937.391815:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.391834:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.391850:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392188:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392198:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392204:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392231:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392240:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392246:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778937.392302:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790778937.392307:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778937.392337:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392348:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392356:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392364:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392370:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.392374:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392382:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392395:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:2.0:1790778937.392398:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778937.392402:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392407:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560750d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392422:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392428:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392434:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392488:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.392491:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392497:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392505:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ef2363a9300) 00010000:00010000:2.0:1790778937.392507:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778937.392510:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392515:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560750d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392529:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392534:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392539:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392544:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.392546:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392551:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392566:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778937.392568:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778937.392571:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.392577:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560750df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.392687:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+56:10456:x1877767510612096:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 1039us (12065us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.392697:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:3.0:1790778937.402606:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.404545:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510612352 00000100:00100000:0.0:1790778937.404563:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510612352 00000100:00100000:0.0:1790778937.404801:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1790778937.404812:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+56:10456:x1877767510612352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778937.404835:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778937.404856:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560750e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd62 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405025:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405041:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405067:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778937.405078:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790778937.405151:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405159:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405167:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405173:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778937.405177:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405185:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405196:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:0.0:1790778937.405199:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790778937.405204:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405210:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560750ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405248:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560750e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd62 expref: 58 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405268:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:0.0:1790778937.405270:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778937.405274:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560750e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd62 expref: 58 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.405283:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0a00, rc 0) 00000100:00100000:0.0:1790778937.405347:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510612352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 538us (2755us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1790778937.405355:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:2.0:1790778937.425545:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.426693:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510612480 00000100:00100000:1.0:1790778937.426715:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510612480 00000100:00100000:1.0:1790778937.426793:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1790778937.426804:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510612480:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790778937.426846:0:7119:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790778937.426997:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510612480:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 195us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.427006:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1790778937.435019:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.435207:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510612736 00000100:00100000:0.0:1790778937.435220:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510612736 00000100:00100000:0.0:1790778937.435304:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:0.0:1790778937.435315:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510612736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778937.435343:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778937.435347:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790778937.435380:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607508b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd46 expref: 57 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.435406:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:0.0:1790778937.435411:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778937.435426:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560750fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd69 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790778937.436263:0:5949:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1790778937.437180:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.437216:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.437228:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.438630:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560750fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd69 expref: 59 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.438687:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd69 expref: 58 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.438700:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef235cc0d00) 00010000:00010000:0.0:1790778937.438703:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778937.438707:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1600, rc 0) 00000100:00100000:2.0:1790778937.443700:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+58:10456:x1877767510612736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 8365us (8672us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1790778937.443725:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1790778937.459544:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.459643:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510612992 00000100:00100000:2.0:1790778937.459653:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510612992 00000100:00100000:2.0:1790778937.459800:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:2.0:1790778937.459809:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+58:10456:x1877767510612992:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790778937.459861:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778937.459887:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd69 expref: 58 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.459917:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef235cc0d00) 00010000:00010000:2.0:1790778937.459928:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778937.459951:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.459980:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.459989:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460004:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460011:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460018:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460058:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460065:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460072:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460078:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.460082:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460090:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460099:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:2.0:1790778937.460109:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778937.460114:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460120:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075110 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460130:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460136:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460142:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460147:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.460150:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460156:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460164:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa2795ec7 (ffff9ef2363a9300) 00010000:00010000:2.0:1790778937.460166:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778937.460169:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.460174:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa2795ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.460250:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510612992:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 443us (717us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790778937.460260:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:0.0:1790778937.469002:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.469168:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510613120 00000100:00100000:3.0:1790778937.469182:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510613120 00000100:00100000:3.0:1790778937.469257:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:3.0:1790778937.469270:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+57:10456:x1877767510613120:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778937.469390:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778937.469420:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607511e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd70 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.469494:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.469510:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.469523:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.469649:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc8763265607511e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 59 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.469671:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 58 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.469697:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:3.0:1790778937.469700:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778937.469704:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:3.0:1790778937.469772:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+58:10456:x1877767510613120:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 505us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.469780:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:3.0:1790778937.477009:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.477365:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510613376 00000100:00100000:1.0:1790778937.477377:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510613376 00000100:00100000:1.0:1790778937.477470:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:1.0:1790778937.477482:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+58:10456:x1877767510613376:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790778937.477563:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.477580:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.477593:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790778937.477798:0:7119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1790778937.477809:0:7119:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331353365821ns, next at 332353362993ns, rc = 0 00000004:00010000:1.0:1790778937.477856:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000029749ba3 reply state 00000000395c6297 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.477865:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790778937.478401:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+60:10456:x1877767510613376:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 919us (1402us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1790778937.478409:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00010000:00010000:3.0:1790778937.486046:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.486067:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.486076:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.486084:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778937.486089:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.486098:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.486116:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:3.0:1790778937.486120:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790778937.486124:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.486131:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc8763265607512c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778937.487472:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.487567:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510613504 00000100:00100000:2.0:1790778937.487576:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510613504 00000100:00100000:2.0:1790778937.487620:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:2.0:1790778937.487629:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+59:10456:x1877767510613504:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778937.487657:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778937.487686:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd77 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.487746:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 60 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.487757:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 60 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.487770:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:2.0:1790778937.487772:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778937.487775:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5400, rc 0) 00000100:00100000:2.0:1790778937.487826:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+60:10456:x1877767510613504:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 198us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.487833:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:1.0:1790778937.493337:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.493496:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510613632 00000100:00100000:0.0:1790778937.493507:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510613632 00000100:00100000:0.0:1790778937.493593:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1790778937.493604:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510613632:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790778937.493851:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510613632:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 249us (522us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790778937.493859:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00080000:3.0:1790778937.494432:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778937.497611:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.497858:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510613888 00000100:00100000:3.0:1790778937.497869:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510613888 00000100:00100000:3.0:1790778937.497988:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1790778937.497999:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+60:10456:x1877767510613888:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790778937.499029:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+61:10456:x1877767510613888:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1028us (1423us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790778937.499040:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1790778937.516342:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.516477:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510614144 00000100:00100000:1.0:1790778937.516487:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510614144 00000100:00100000:1.0:1790778937.516539:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:1.0:1790778937.516547:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+61:10456:x1877767510614144:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790778937.516653:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+61:10456:x1877767510614144:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 107us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.517195:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:3.0:1790778937.520495:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.520596:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510614272 00000100:00100000:2.0:1790778937.520608:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510614272 00000100:00100000:2.0:1790778937.520696:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:2.0:1790778937.520718:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+61:10456:x1877767510614272:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778937.520764:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778937.520791:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607513a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd7e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.520867:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.520883:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.520895:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778937.520963:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778937.520987:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.521018:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607513a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd7e expref: 63 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.521036:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd7e expref: 62 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.521046:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:2.0:1790778937.521049:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790778937.521052:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5000, rc 0) 00000100:00100000:2.0:1790778937.521116:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+62:10456:x1877767510614272:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 411us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.521123:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:0.0:1790778937.530534:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.530835:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510614400 00000100:00100000:3.0:1790778937.530847:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510614400 00000100:00100000:3.0:1790778937.530932:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1790778937.530944:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510614400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778937.530971:0:6937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778937.531008:0:6937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd85 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778937.531046:0:6937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1e39, blocks: 0x0 00010000:00010000:3.0:1790778937.531209:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1790778937.531216:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778937.531228:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 10 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.531255:0:6937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 10 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.531289:0:6937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:3.0:1790778937.531414:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+10:2345:x1877767510614400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 472us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.531423:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:0.0:1790778937.547325:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.547484:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510614656 00000100:00100000:2.0:1790778937.547496:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510614656 00000100:00100000:2.0:1790778937.547560:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:2.0:1790778937.547571:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+62:10456:x1877767510614656:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790778937.547718:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+62:10456:x1877767510614656:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.547726:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:1.0:1790778937.553665:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.554495:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510614784 00000100:00100000:0.0:1790778937.554522:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510614784 00000100:00100000:0.0:1790778937.554580:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1790778937.554591:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+10:10456:x1877767510614784:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778937.554613:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778937.554633:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd8c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.554687:0:6934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 11 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.554698:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778937.554702:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778937.554716:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 11 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.554754:0:6934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 11 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.554768:0:6934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 11 pid: 6937 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.554783:0:6934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6934:1877767531598592:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778937.554897:0:6934:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233266000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778937.560153:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.560293:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510614912 00000100:00100000:1.0:1790778937.560367:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510614912 00010000:00010000:1.0:1790778937.560410:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 12 pid: 6937 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.560475:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1790778937.560483:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+12:2346:x1877767510614912:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778937.560514:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778937.560535:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 12 pid: 6937 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.560547:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 12 pid: 6937 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.560571:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778937.560574:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778937.560582:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 12 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.560588:0:5935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 12 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.560622:0:5935:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 12 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.560634:0:5935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5935:1877767531598720:192.168.202.2@tcp:105: 00000100:00100000:1.0:1790778937.560790:0:5935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20555cc00 going to sleep for 11 seconds 00010000:00010000:2.0:1790778937.560885:0:6934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075148 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd85 expref: 12 pid: 6937 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.560900:0:6934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6934:1877767531598592:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778937.560933:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 11 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.560944:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0a00, rc 0) 00000100:00100000:2.0:1790778937.560973:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+11:10456:x1877767510614784:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 6384us (7318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.560980:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1790778937.564419:0:5935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5935:1877767531598720:192.168.202.2@tcp:105: 00010000:00010000:1.0:1790778937.564499:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778937.564559:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+10:2346:x1877767510614912:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4074us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.564570:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:0.0:1790778937.567987:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.568114:0:6940:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510615040 00000100:00100000:1.0:1790778937.568123:0:6940:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510615040 00002000:00100000:1.0:1790778937.568173:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ef2368f9f80 x1877767510615040/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:488/0 lens 504/0 e 0 to 0 dl 1790778948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778937.568181:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2368f9f80 with x1877767510615040 ext(0->12) 00002000:00010000:1.0:1790778937.568186:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2368f9f80 00000100:00100000:1.0:1790778937.568239:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1790778937.568246:0:6940:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+10:2346:x1877767510615040:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790778937.569169:0:6940:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+12:2346:x1877767510615040:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 919us (1188us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790778937.569178:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00002000:00100000:1.0:1790778937.569187:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ef2368f9f80 x1877767510615040/t4294967308(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:488/0 lens 504/448 e 0 to 0 dl 1790778948 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778937.569257:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2368f9f80 with x1877767510615040 ext(0->12) 00002000:00010000:1.0:1790778937.569261:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2368f9f80 00000100:00100000:0.0:1790778937.571393:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.571839:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510615168 00000100:00100000:2.0:1790778937.571848:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510615168 00000100:00100000:2.0:1790778937.571947:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:2.0:1790778937.571955:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+62:10456:x1877767510615168:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790778937.575117:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1790778937.575134:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1790778937.575176:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1790778937.575205:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef2363d5780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1790778937.575211:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef23b808b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2363d5000 00000020:00080000:1.0:1790778937.575214:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef23b808800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2332ec000 00000004:00080000:1.0:1790778937.575249:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1790778937.575274:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef2052f5180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1790778937.575278:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef2063f9a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2278fa900 00000020:00080000:1.0:1790778937.575292:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef2063f9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef204cca400 00000100:00100000:0.0:1790778937.575488:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531598976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790778937.575547:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.575577:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778937.575580:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531598848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790778937.575592:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778937.575612:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531598976 00000100:00100000:0.0:1790778937.575618:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531598976 00000100:00100000:0.0:1790778937.575654:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531598848 00000100:00100000:0.0:1790778937.575656:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531598848 00000100:00100000:0.0:1790778937.575673:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790778937.575691:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531598976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790778937.575824:0:6935:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790778937.575828:0:6935:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790778937 00002000:00010000:0.0:1790778937.575829:0:6935:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790778937.575831:0:6935:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790778937 -> 1790778937 00002000:00010000:0.0:1790778937.575833:0:6935:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1790778937.575867:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3442:x1877767531598976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (319us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790778937.575873:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790778937.575892:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790778937.575898:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531598848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790778937.575912:0:6935:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1790778937.575929:0:6935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.575949:0:6935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 11 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.575972:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790778937.575976:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778937.575980:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.576003:0:6935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 11 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.576015:0:6935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 11 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.576025:0:6935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6935:1877767531599104:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778937.576080:0:6935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233266840 going to sleep for 11 seconds 00000004:00080000:0.0:1790778937.576107:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236726680/2, rc 0, transno 4294967309 00000100:00100000:0.0:1790778937.576111:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531598976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790778937.576639:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+16:10456:x1877767510615168:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 4684us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.576646:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:1.0:1790778937.576730:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531599232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790778937.576761:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1790778937.576937:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1790778937.576998:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790778937.577010:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531599232 00000100:00100000:3.0:1790778937.577014:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531599232 00000100:00100000:3.0:1790778937.577052:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790778937.577061:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531599232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790778937.577090:0:6937:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1790778937.577120:0:6937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd1e38, atime: 0x6abd1e38, ctime: 0x6abd1e38, blocks: 0x8 00010000:00010000:3.0:1790778937.577127:0:6937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577140:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1790778937.577144:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778937.577151:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577169:0:6937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577180:0:6937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577203:0:6937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577225:0:6937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790778937.577340:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531599232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 280us (577us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790778937.577347:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1790778937.577365:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778937.577371:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577379:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778937.577384:0:6950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577393:0:6950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577410:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577415:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033cfe244/0xdc8763265607515d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.577430:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778937.577436:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778937.577437:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790778937.577484:0:3439:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236865880/2, rc 0, transno 4294967304 00000100:00100000:3.0:1790778937.577488:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531599232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790778937.582471:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.582499:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.582594:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510615424 00000100:00100000:3.0:1790778937.582604:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510615424 00000100:00100000:3.0:1790778937.582651:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1790778937.582659:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+12:2345:x1877767510615424:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790778937.582776:0:6935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6935:1877767531599104:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778937.582801:0:6935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.583698:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510615296 00000100:00100000:1.0:1790778937.584982:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510615296 00010000:00010000:1.0:1790778937.585035:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 13 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.585143:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1790778937.585152:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+13:2345:x1877767510615296:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778937.585179:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778937.585186:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 13 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.585199:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 13 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.585220:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bc76683/0xdc87632656074f0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcce4 expref: 13 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.585236:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778937.585240:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778937.585245:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.585282:0:12059:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.585315:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1790778937.587287:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1790778937.587304:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1790778937.588095:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510615296:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 2930us (5646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.588110:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00010000:00010000:0.0:1790778937.588224:0:6935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588240:0:6935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588253:0:6935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588278:0:6935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588313:0:6935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790778937.588737:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531598848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12839us (13142us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790778937.588746:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1790778937.588766:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778937.588771:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588780:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790778937.588785:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588795:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588812:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588819:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.588838:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778937.588845:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778937.588846:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778937.588876:0:3442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790778937.588883:0:3442:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1790778937.588902:0:3442:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236726680, transno 4294967309 00000100:00100000:0.0:1790778937.588914:0:3442:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ef2368f8000 x1877767531598848/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790778953 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790778937.588926:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef2368f8000/2, rc 0, transno 4294967310 00000100:00100000:0.0:1790778937.588931:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531598848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790778937.589978:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510615424:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 7303us (7462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.589995:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:0.0:1790778937.598572:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.599190:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510615680 00000100:00100000:2.0:1790778937.599210:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510615680 00000100:00100000:2.0:1790778937.599299:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:2.0:1790778937.599309:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+16:10456:x1877767510615680:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790778937.599388:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778937.599436:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd7e expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.599500:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:2.0:1790778937.599506:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778937.599561:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.599580:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.599592:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790778937.599883:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000010527e0 reply state 0000000072d49c5f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.599894:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778937.600052:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+17:10456:x1877767510615680:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 743us (1488us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1790778937.601781:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00010000:00010000:2.0:1790778937.604788:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.604813:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.604823:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.604832:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.604838:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.604848:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.604868:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:2.0:1790778937.604871:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778937.604877:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.604883:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075164 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.609740:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.610053:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510615808 00000100:00100000:1.0:1790778937.610078:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510615808 00000100:00100000:1.0:1790778937.610153:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1790778937.610164:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510615808:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790778937.610352:0:6934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790778937.610357:0:6934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790778937 -> 1790778936 00002000:00010000:1.0:1790778937.610360:0:6934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790778936 00002000:00010000:1.0:1790778937.610363:0:6934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790778937 -> 1790778936 00002000:00010000:1.0:1790778937.610365:0:6934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790778937.610482:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510615808:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 319us (757us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790778937.610490:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:0.0:1790778937.617121:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.617487:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616064 00000100:00100000:3.0:1790778937.617501:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616064 00000100:00100000:2.0:1790778937.622345:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:2.0:1790778937.622396:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+16:10456:x1877767510616064:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790778937.622504:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.622540:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.622550:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.622586:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.622601:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 16 pid: 5950 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.622618:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236865500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531599360:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778937.622753:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790778937.628369:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236865500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531599360:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778937.628413:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.629037:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.629236:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616192 00000100:00100000:3.0:1790778937.629248:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616192 00010000:00010000:3.0:1790778937.629305:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 17 pid: 5950 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778937.629418:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:3.0:1790778937.629430:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+17:2346:x1877767510616192:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778937.629492:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778937.629502:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 17 pid: 5950 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.629516:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 17 pid: 5950 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.629589:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd70 expref: 17 pid: 5950 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.629623:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:3.0:1790778937.629629:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.629641:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.629651:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.629687:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778937.629779:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+16:2346:x1877767510616192:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 350us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.629788:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00010000:00010000:0.0:1790778937.629969:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.629979:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630042:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630051:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630059:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630078:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778937.630084:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630094:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630105:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:0.0:1790778937.630108:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790778937.630114:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.630122:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607516b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.630178:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+15:10456:x1877767510616064:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 7818us (13073us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790778937.630186:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:2.0:1790778937.636560:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.636763:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616320 00000100:00100000:0.0:1790778937.636779:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616320 00000100:00100000:0.0:1790778937.636844:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1790778937.636856:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510616320:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790778937.636921:0:6935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.636945:0:6935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.636977:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778937.636981:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778937.636986:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.637050:0:6935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 7 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.637065:0:6935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 7 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.637082:0:6935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236811500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6935:1877767531599488:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778937.637199:0:6935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233266840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778937.639756:0:6935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236811500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6935:1877767531599488:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778937.639791:0:6935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.640515:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.640736:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616448 00000100:00100000:1.0:1790778937.640747:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616448 00010000:00010000:1.0:1790778937.640799:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 8 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.640851:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:1.0:1790778937.640884:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510616448:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778937.640906:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778937.640936:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 8 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.640951:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 8 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.640987:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc8763265607514f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd8c expref: 8 pid: 6934 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.641010:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778937.641015:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778937.641023:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.641036:0:5933:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.641161:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778937.641233:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510616448:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 351us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.641241:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00010000:00010000:2.0:1790778937.643544:0:6935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643762:0:6935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643798:0:6935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643809:0:6935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643839:0:6935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643845:0:6935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778937.643849:0:6935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643856:0:6935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643878:0:6935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.643883:0:6935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000487ddbc6/0xdc87632656075172 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.644269:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510616320:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 7411us (7714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.644277:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1790778937.650109:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.650384:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616704 00000100:00100000:1.0:1790778937.650399:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616704 00000100:00100000:1.0:1790778937.650956:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:1.0:1790778937.650971:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+15:10456:x1877767510616704:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790778937.651114:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.651137:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 15 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.651149:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.651195:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 15 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.651213:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 15 pid: 7119 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.651231:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531599616:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778937.651379:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20555cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778937.653585:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531599616:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778937.653619:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.655431:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.655736:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616832 00000100:00100000:1.0:1790778937.655749:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616832 00010000:00010000:1.0:1790778937.655807:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 16 pid: 7119 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.655846:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1790778937.655857:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+16:2345:x1877767510616832:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778937.655902:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778937.655910:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 16 pid: 7119 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.655926:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 16 pid: 7119 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.655953:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd38 expref: 16 pid: 7119 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.655972:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778937.655978:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.655990:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.656000:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.656008:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.656047:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778937.656137:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+15:2345:x1877767510616832:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 281us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.656146:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00010000:00010000:2.0:1790778937.656693:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.656706:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.656974:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.656990:0:7119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 15 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.656999:0:7119:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.657044:0:7119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 15 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.657061:0:7119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 15 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.657092:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236867100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531599744:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778937.657190:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778937.664783:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236867100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531599744:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778937.664850:0:7119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.667233:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.667683:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510616960 00000100:00100000:0.0:1790778937.667697:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510616960 00010000:00010000:0.0:1790778937.667758:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 16 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778937.667814:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1790778937.667826:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+16:2346:x1877767510616960:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778937.667866:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778937.667875:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 16 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.667891:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 16 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.667920:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd77 expref: 16 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.667941:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:0.0:1790778937.667947:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.667960:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.667970:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.668024:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778937.668131:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+15:2346:x1877767510616960:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 305us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778937.668140:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00010000:00010000:2.0:1790778937.669061:0:7119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.669085:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778937.669247:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1790778937.669412:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1790778937.669903:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1790778937.670028:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236865500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531599872:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790778937.670368:0:7119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778937.670527:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778937.671638:0:5954:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531599872 00000100:00100000:3.0:1790778937.671654:0:5954:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531599872 00000100:00100000:3.0:1790778937.671990:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790778937.672003:0:5954:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7119:x1877767531599872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790778937.673016:0:5954:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7119:x1877767531599872:12345-0@lo:1000:mdt00_003.0 Request processed in 1009us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.673027:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790778937.673306:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236865500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531599872:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790778937.673752:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1790778937.673839:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236865500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531600000:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790778937.673889:0:7119:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778937.673926:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f5540 going to sleep for 11 seconds 00000100:00100000:1.0:1790778937.674004:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531600000 00000100:00100000:1.0:1790778937.674012:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531600000 00000100:00100000:1.0:1790778937.674392:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790778937.674402:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7119:x1877767531600000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790778937.674597:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7119:x1877767531600000:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (707us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790778937.674605:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790778937.674693:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236865500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7119:1877767531600000:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790778937.674744:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674756:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674765:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674772:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.674778:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674787:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674806:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef227ba9800) 00010000:00010000:2.0:1790778937.674810:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778937.674815:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674822:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075180 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674880:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674886:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674892:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674898:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778937.674901:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674907:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674915:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778937.674918:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778937.674926:0:7119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674939:0:7119:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674950:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.674983:0:7119:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.675009:0:7119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531600128:192.168.202.2@tcp:105: 00000100:00100000:2.0:1790778937.675117:0:7119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1790778937.681232:0:7119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236725c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7119:1877767531600128:192.168.202.2@tcp:105: 00010000:00010000:3.0:1790778937.681275:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681328:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560750c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681375:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681397:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681412:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681427:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681434:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681469:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681477:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778937.681481:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681492:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681506:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778937.681510:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778937.681514:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681527:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075187 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681540:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681547:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681553:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681559:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778937.681572:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681580:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681589:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778937.681592:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778937.681595:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.681601:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075179 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778937.681855:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:10456:x1877767510616704:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 30886us (31762us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1790778937.681868:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000020:00080000:3.0:1790778937.681881:0:7119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790778937.682173:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778937.682181:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778937.682741:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1790778937.682754:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790778937.685421:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.685849:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510617088 00000100:00100000:0.0:1790778937.685880:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510617088 00000100:00100000:0.0:1790778937.685956:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1790778937.685970:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:10455:x1877767510617088:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:0.0:1790778937.686185:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:10455:x1877767510617088:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 219us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778937.686194:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1790778937.689355:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.689572:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510617344 00000100:00100000:3.0:1790778937.689585:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510617344 00000100:00100000:3.0:1790778937.689647:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:3.0:1790778937.689658:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:10455:x1877767510617344:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:3.0:1790778937.689898:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790778937.690009:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:10455:x1877767510617344:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 351us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778937.690018:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:2.0:1790778937.692532:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778937.692696:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510617600 00000100:00100000:0.0:1790778937.692710:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510617600 00000100:00100000:0.0:1790778937.692792:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1790778937.692803:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f78850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:10456:x1877767510617600:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790778937.693234:0:5953:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790778937.693281:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1790778937.693332:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693355:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693370:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693381:0:5953:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693388:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693396:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693470:0:5953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790778937.693664:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f78850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:10456:x1877767510617600:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 860us (1141us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1790778937.693682:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000020:00080000:0.0:1790778937.693690:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790778937.693763:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778937.693772:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693781:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790778937.693787:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693798:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693813:0:5936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef235cc0b00) 00010000:00010000:0.0:1790778937.693816:0:5936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790778937.693822:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693828:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607518e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778937.693849:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778937.693852:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778937.693854:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778937.726940:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778937.727053:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510617728 00000100:00100000:3.0:1790778937.727077:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510617728 00000100:00100000:3.0:1790778937.727161:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:3.0:1790778937.727176:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+20:10458:x1877767510617728:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778937.727213:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778937.727246:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd93 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727350:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727369:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727380:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727395:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727425:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727430:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727583:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727593:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727610:0:5951:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727666:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778937.727692:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 21 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778937.727710:0:5951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531600256:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778937.728169:0:5951:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006000 going to sleep for 11 seconds 00000100:00100000:0.0:1790778937.733621:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778937.733735:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510617984 00000100:00100000:1.0:1790778937.733748:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510617984 00000100:00100000:1.0:1790778937.733825:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1790778937.733838:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+22:5434:x1877767510617984:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790778937.734116:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:5434:x1877767510617984:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 280us (509us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1790778937.734124:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1790778937.735954:0:5951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5951:1877767531600256:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778937.735991:0:5951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778937.740181:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778937.740577:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510618112 00000100:00100000:2.0:1790778937.740593:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510618112 00010000:00010000:2.0:1790778937.740653:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 23 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778937.740716:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:2.0:1790778937.740727:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+23:2345:x1877767510618112:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778937.740748:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778937.740756:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 23 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.740772:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 23 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.740809:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560750b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd54 expref: 23 pid: 5949 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.740827:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778937.740833:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.740869:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.740878:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778937.740920:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778937.740998:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+22:2345:x1877767510618112:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 272us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778937.741007:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00010000:00010000:1.0:1790778937.741410:0:5951:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741421:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778937.741522:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790778937.741528:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778937.741554:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741584:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741596:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741604:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741612:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741618:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778937.741624:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741632:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741643:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778937.741646:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778937.741651:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741658:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607519c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741682:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741690:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741704:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741709:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778937.741713:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741720:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741729:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef227ba9300) 00010000:00010000:1.0:1790778937.741732:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778937.741736:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741742:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741787:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd93 expref: 22 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741817:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd93 expref: 21 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778937.741825:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778937.741828:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778937.741831:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa200, rc 0) 00000100:00100000:1.0:1790778937.741874:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+21:10458:x1877767510617728:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 14702us (14948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778937.741892:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00010000:00010000:3.0:1790778938.124928:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790778938.704900:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790778938.704910:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790778938.704942:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790778938.704953:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790778938.705114:0:12077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531600384:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790778938.705221:0:12077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778938.718908:0:12077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531600384:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790778938.719532:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778938.720030:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510618240 00000100:00100000:3.0:1790778938.720155:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510618240 00000100:00100000:3.0:1790778938.720230:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:3.0:1790778938.720240:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:10469:x1877767510618240:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790778938.720283:0:5950:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790778938.720404:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:10469:x1877767510618240:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 165us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778938.720412:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:1.0:1790778938.723335:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778938.725170:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510618496 00000100:00100000:2.0:1790778938.725183:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510618496 00000100:00100000:2.0:1790778938.725243:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:2.0:1790778938.725254:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+21:10469:x1877767510618496:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778938.725278:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778938.725303:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcd9a expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778938.725422:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560751b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778938.725438:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560751b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778938.725488:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560751b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778938.725500:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790778938.725609:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd9a expref: 24 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778938.725630:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560751b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd9a expref: 23 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778938.725638:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778938.725642:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778938.725646:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4000, rc 0) 00000100:00100000:2.0:1790778938.725722:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+23:10469:x1877767510618496:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 469us (2396us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790778938.725730:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:2.0:1790778938.735405:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778938.735556:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778938.735599:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510618880 00000100:00100000:2.0:1790778938.735609:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510618880 00000100:00100000:2.0:1790778938.735684:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1790778938.735694:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+23:2346:x1877767510618880:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778938.735709:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778938.735733:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc876326560751b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd9a expref: 23 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778938.735752:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778938.735758:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778938.735813:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+22:2346:x1877767510618880:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778938.735834:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1790778938.741658:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510618752 00000100:00100000:3.0:1790778938.741687:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510618752 00000100:00100000:3.0:1790778938.741791:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:3.0:1790778938.741803:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+22:10469:x1877767510618752:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790778938.741905:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.741924:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.741935:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742480:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742490:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742497:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742504:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778938.742508:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742516:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742529:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:3.0:1790778938.742532:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778938.742538:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778938.742545:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778938.742706:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:10469:x1877767510618752:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 905us (7311us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1790778938.742716:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 135 00000040:00080000:2.0:1790778938.742868:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778938.742878:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778938.743359:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790778938.743368:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790778938.744853:0:12489:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790778938.744860:0:12489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790778938.748151:0:12489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790778938.748165:0:12489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778938.755958:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778938.756258:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510619136 00000100:00100000:1.0:1790778938.756268:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510619136 00000100:00100000:1.0:1790778938.756324:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:1.0:1790778938.756335:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:10469:x1877767510619136:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790778938.756578:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+24:10469:x1877767510619136:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 244us (627us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790778938.756586:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1790778939.017279:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778939.017356:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510619392 00000100:00100000:1.0:1790778939.017368:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510619392 00000100:00080000:0.0:1790778939.017423:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778939.017487:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:1.0:1790778939.017501:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+24:10482:x1877767510619392:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778939.017534:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778939.017557:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560751cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcda1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.017681:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc876326560751d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.017697:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc876326560751d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.017720:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc876326560751d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778939.017734:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790778939.018148:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386600/0xdc876326560751cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcda1 expref: 27 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.018169:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc876326560751d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcda1 expref: 26 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.018179:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778939.018183:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790778939.018186:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387c00, rc 0) 00000100:00100000:1.0:1790778939.018753:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+26:10482:x1877767510619392:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1254us (1481us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1790778939.018762:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:0.0:1790778939.048010:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778939.055553:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510619520 00000100:00100000:2.0:1790778939.055572:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510619520 00000100:00100000:2.0:1790778939.055672:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:2.0:1790778939.055684:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+26:10482:x1877767510619520:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1790778939.055758:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055777:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055790:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055841:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055850:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055858:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055865:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778939.055870:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055878:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055908:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:2.0:1790778939.055911:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778939.055917:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778939.055923:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560751e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778939.056016:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+26:10482:x1877767510619520:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 334us (8017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778939.056024:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 137 00010000:00010000:0.0:1790778939.147544:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778939.339097:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778939.339202:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510619648 00000100:00100000:1.0:1790778939.339213:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510619648 00000100:00100000:1.0:1790778939.339293:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:1.0:1790778939.339306:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2344:x1877767510619648:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1790778939.339328:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778939.339351:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b781af7f/0xdc876326560751e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcda8 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778939.339378:0:6934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd1e38, atime: 0x6abd1e38, ctime: 0x6abd1e38, blocks: 0x8 00010000:00010000:1.0:1790778939.339398:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1790778939.339417:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:0.0:1790778939.339417:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790778939.339427:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b781af7f/0xdc876326560751e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcda8 expref: 7 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.339491:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b781af7f/0xdc876326560751e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcda8 expref: 7 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778939.339506:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386600, rc 0) 00000100:00100000:1.0:1790778939.339561:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2344:x1877767510619648:12345-192.168.202.2@tcp:101:cat.0 Request processed in 258us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778939.339568:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:1.0:1790778939.362643:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778939.362724:0:6942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510619776 00000100:00100000:0.0:1790778939.362736:0:6942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510619776 00002000:00100000:0.0:1790778939.362798:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ef2368f9c00 x1877767510619776/t0(0) o3->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:490/0 lens 488/0 e 0 to 0 dl 1790778950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790778939.362810:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2368f9c00 with x1877767510619776 ext(0->4095) 00002000:00010000:0.0:1790778939.362817:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2368f9c00 00000100:00100000:0.0:1790778939.362857:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1790778939.362868:0:6942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510619776:12345-192.168.202.2@tcp:3:cat.0 00000100:00100000:0.0:1790778939.363306:0:6942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510619776:12345-192.168.202.2@tcp:3:cat.0 Request processed in 439us (675us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790778939.363315:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00002000:00100000:0.0:1790778939.363321:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ef2368f9c00 x1877767510619776/t0(0) o3->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:490/0 lens 488/4536 e 0 to 0 dl 1790778950 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790778939.363329:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2368f9c00 with x1877767510619776 ext(0->4095) 00002000:00010000:0.0:1790778939.363333:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2368f9c00 00000100:00100000:3.0:1790778939.403885:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778939.403914:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531600512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778939.404007:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778939.404115:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531600512 00000100:00100000:3.0:1790778939.404125:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531600512 00000100:00100000:3.0:1790778939.404181:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790778939.404192:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531600512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778939.404229:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25563712 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778939.404274:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531600512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778939.404282:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790778939.404328:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531600512:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790778939.406238:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778939.406482:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778939.406511:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531600640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778939.407282:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778939.407428:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531600640 00000100:00100000:1.0:1790778939.407439:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531600640 00000100:00100000:1.0:1790778939.407551:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778939.407561:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531600640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778939.407597:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1790778939.407647:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531600640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778939.407654:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790778939.408112:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531600640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790778939.408580:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1790778939.791378:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778939.791389:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778939.791416:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790778939.791426:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790778940.171751:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778941.195779:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778941.262409:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778941.262492:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778941.262526:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778941.262550:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778941.262572:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778941.262602:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620288 00000100:00100000:0.0:1790778941.262613:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620288 00000100:00100000:0.0:1790778941.262686:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620160 00000100:00100000:0.0:1790778941.262690:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620160 00000100:00100000:0.0:1790778941.262717:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:0.0:1790778941.262729:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510620288:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778941.262823:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510620288:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 96us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.262831:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:0.0:1790778941.262852:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:0.0:1790778941.262859:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510620160:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778941.263382:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620032 00000100:00100000:3.0:1790778941.263387:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620032 00000100:00100000:3.0:1790778941.263454:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620416 00000100:00100000:3.0:1790778941.263458:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620416 00000100:00100000:3.0:1790778941.263480:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:3.0:1790778941.263487:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:2345:x1877767510620032:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778941.263522:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:2345:x1877767510620032:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 35us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.263529:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:3.0:1790778941.263541:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:3.0:1790778941.263546:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510620416:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778941.263567:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510620416:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 20us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778941.263572:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:0.0:1790778941.263732:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510620160:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 872us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.263740:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:0.0:1790778941.263760:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510619904 00000100:00100000:0.0:1790778941.263764:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510619904 00000100:00100000:0.0:1790778941.264150:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 291 00000100:00100000:0.0:1790778941.264160:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510619904:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778941.264188:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510619904:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 30us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778941.264205:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 291 00000100:00080000:0.0:1790778941.274586:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790778941.274617:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790778941.274620:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790778941.976135:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1790778941.976164:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1790778942.219650:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778942.476344:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778942.476367:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531600896:0@lo:400:kworker.0 00000100:00100000:3.0:1790778942.476507:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778942.476582:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531600896 00000100:00100000:3.0:1790778942.476590:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531600896 00000100:00100000:3.0:1790778942.476660:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790778942.476670:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531600896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778942.476730:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531600896:12345-0@lo:400:kworker.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778942.476737:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790778942.476779:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531600896:0@lo:400:kworker.0 00000100:00100000:3.0:1790778942.476835:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531601024:0@lo:400:kworker.0 00000100:00100000:0.0:1790778942.476944:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531601408:0@lo:400:kworker.0 00000100:00100000:0.0:1790778942.476976:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778942.477006:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601408 00000100:00100000:0.0:1790778942.477010:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601408 00000100:00100000:0.0:1790778942.477045:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790778942.477053:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531601408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778942.477088:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531601408:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778942.477094:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1790778942.477112:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778942.477130:0:3439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1790778942.477135:0:3439:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1790778942.477149:0:3439:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236865880, transno 4294967304 00000100:00100000:0.0:1790778942.477158:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531601408:0@lo:400:kworker.0 00000100:00100000:3.0:1790778942.478008:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778942.478125:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531600768:0@lo:400:kworker.0 00000100:00100000:2.0:1790778942.478166:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778942.478200:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531601280:0@lo:400:kworker.0 00000100:00100000:2.0:1790778942.478222:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778942.478242:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778942.478248:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531601152:0@lo:400:kworker.0 00000100:00100000:2.0:1790778942.478266:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778942.478390:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601024 00000100:00100000:2.0:1790778942.478405:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601024 00000100:00100000:2.0:1790778942.478458:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601280 00000100:00100000:2.0:1790778942.478461:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601280 00000100:00100000:2.0:1790778942.478484:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790778942.478490:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531601024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778942.478532:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531601024:12345-0@lo:400:kworker.0 Request processed in 42us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778942.478539:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790778942.478552:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790778942.478558:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531601280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778942.478588:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531601280:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778942.478593:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1790778942.478610:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778942.478638:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531601280:0@lo:400:kworker.0 00000100:00100000:2.0:1790778942.478666:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531601024:0@lo:400:kworker.0 00000100:00100000:3.0:1790778942.478734:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531600768 00000100:00100000:3.0:1790778942.478738:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531600768 00000100:00100000:3.0:1790778942.478771:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790778942.478778:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531600768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778942.478814:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531600768:12345-0@lo:400:kworker.0 Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778942.478821:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790778942.478850:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531600768:0@lo:400:kworker.0 00000100:00100000:0.0:1790778942.481258:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601152 00000100:00100000:0.0:1790778942.481271:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601152 00000100:00100000:0.0:1790778942.481377:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790778942.481389:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531601152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778942.481509:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531601152:12345-0@lo:400:kworker.0 Request processed in 122us (3239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778942.481516:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1790778942.481673:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778942.485092:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531601152:0@lo:400:kworker.0 00000001:00080000:2.0:1790778942.995744:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1790778942.995780:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef2052f5d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790778942.995786:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef206340d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2052f50c0 00000020:00080000:2.0:1790778942.995789:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef206340200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef236895e00 00000020:00080000:2.0:1790778942.995803:0:5927:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1790778942.995876:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1790778942.996776:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1790778942.999352:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1790778942.999368:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1790778943.248991:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778944.267688:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778944.530414:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531601536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778944.530560:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778944.530785:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601536 00000100:00100000:3.0:1790778944.530796:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601536 00000100:00100000:3.0:1790778944.530883:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790778944.530893:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531601536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778944.530936:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778944.531007:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531601536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778944.531015:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1790778944.531371:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778944.531423:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531601536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778944.532575:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790778944.540598:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531601664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778944.541042:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778944.547072:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601664 00000100:00100000:2.0:1790778944.547090:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601664 00000100:00100000:2.0:1790778944.547196:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790778944.547208:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531601664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790778944.547253:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:2.0:1790778944.547362:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531601664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (6321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778944.547370:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790778944.547594:0:3442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1790778944.547602:0:3442:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef2368f8000, transno 4294967310 00000004:00080000:1.0:1790778944.547629:0:3442:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1790778944.547669:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531601664:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790778944.549038:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790778945.294839:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778946.316720:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778946.380434:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778946.380509:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778946.380539:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778946.380560:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778946.380583:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778946.380624:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510621056 00000100:00100000:3.0:1790778946.380646:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510621056 00000100:00100000:3.0:1790778946.380704:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620672 00000100:00100000:3.0:1790778946.380707:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620672 00000100:00100000:3.0:1790778946.380733:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:3.0:1790778946.380743:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510621056:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778946.380827:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510621056:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.380835:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:3.0:1790778946.380864:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:3.0:1790778946.380871:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:2345:x1877767510620672:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778946.380896:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:2345:x1877767510620672:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.380903:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:3.0:1790778946.380924:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620800 00000100:00100000:3.0:1790778946.380941:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620800 00000100:00100000:3.0:1790778946.380970:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620928 00000100:00100000:3.0:1790778946.380973:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620928 00000100:00100000:3.0:1790778946.381006:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:3.0:1790778946.381013:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510620800:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778946.381043:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510620800:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.381049:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:3.0:1790778946.381060:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1790778946.381066:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510620928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778946.381089:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510620928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778946.381095:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00080000:3.0:1790778946.381111:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778946.381115:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778946.381118:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778946.381318:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510620544 00000100:00100000:1.0:1790778946.381329:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510620544 00000100:00100000:1.0:1790778946.381369:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 293 00000100:00100000:1.0:1790778946.381376:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510620544:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778946.381411:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510620544:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 35us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778946.381417:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 293 00000100:00100000:3.0:1790778946.598585:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778946.598756:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510621184 00000100:00100000:2.0:1790778946.598766:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510621184 00000100:00100000:2.0:1790778946.598851:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:2.0:1790778946.598861:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:10135:x1877767510621184:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790778946.599005:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:10135:x1877767510621184:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 144us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778946.599012:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:1.0:1790778946.602163:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778946.614236:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510621440 00000100:00100000:0.0:1790778946.614254:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510621440 00000100:00100000:0.0:1790778946.614326:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1790778946.614336:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:10135:x1877767510621440:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790778946.614679:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:10135:x1877767510621440:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 343us (12525us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790778946.614687:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00010000:00010000:3.0:1790778947.345388:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778947.602310:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531601792:0@lo:400:kworker.0 00000100:00100000:0.0:1790778947.602417:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778947.602501:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601792 00000100:00100000:2.0:1790778947.602512:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601792 00000100:00100000:2.0:1790778947.602571:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790778947.602591:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531601792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778947.602660:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531601792:12345-0@lo:400:kworker.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778947.602669:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790778947.602789:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531601792:0@lo:400:kworker.0 00000100:00100000:0.0:1790778947.615490:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531601920:0@lo:400:kworker.0 00000100:00100000:0.0:1790778947.615607:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778947.615754:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531602048:0@lo:400:kworker.0 00000100:00100000:2.0:1790778947.615786:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778947.615841:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531601920 00000100:00100000:2.0:1790778947.615848:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531601920 00000100:00100000:2.0:1790778947.615926:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602048 00000100:00100000:2.0:1790778947.615931:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602048 00000100:00100000:2.0:1790778947.615961:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790778947.615970:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531601920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778947.616089:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790778947.616100:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531602048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778947.616146:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531602048:12345-0@lo:400:kworker.0 Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778947.616152:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1790778947.616195:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778947.616242:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531602048:0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.628305:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790778947.628338:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531602432:0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.628428:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778947.628505:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602432 00000100:00100000:1.0:1790778947.628514:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602432 00000100:00100000:1.0:1790778947.628575:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790778947.628597:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531602432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.628652:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531602432:12345-0@lo:400:kworker.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778947.628660:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1790778947.628686:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778947.628729:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531602432:0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.628764:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531602304:0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.628792:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778947.628814:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778947.628819:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531602176:0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.628839:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778947.628919:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602304 00000100:00100000:1.0:1790778947.628924:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602304 00000100:00100000:1.0:1790778947.628971:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790778947.628977:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531602304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.629013:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531602304:12345-0@lo:400:kworker.0 Request processed in 36us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778947.629149:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602176 00000100:00100000:3.0:1790778947.629161:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602176 00000100:00100000:3.0:1790778947.629190:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790778947.629196:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778947.629232:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531602176:12345-0@lo:400:kworker.0 Request processed in 37us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778947.629237:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1790778947.629263:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778947.629266:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778947.629313:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790778947.629342:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531602176:0@lo:400:kworker.0 00000100:00100000:1.0:1790778947.629350:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531602304:0@lo:400:kworker.0 00000100:00100000:2.0:1790778947.632154:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531601920:12345-0@lo:400:kworker.0 Request processed in 16173us (16535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778947.632169:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790778947.632312:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531601920:0@lo:400:kworker.0 00010000:00010000:1.0:1790778948.366670:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790778948.705753:0:12687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:35:47 (1790778947) 00000040:00080000:2.0:1790778949.003773:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778949.003783:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778949.007665:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1790778949.007685:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1790778949.009096:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1790778949.009113:0:5927:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1790778949.009219:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790778949.009239:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1790778949.387701:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778949.644166:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531602560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778949.644248:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778949.644473:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602560 00000100:00100000:1.0:1790778949.644481:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602560 00000100:00100000:1.0:1790778949.644547:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790778949.644565:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531602560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778949.644596:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00080000:2.0:1790778949.644722:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778949.644812:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531602560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778949.644819:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790778949.645408:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531602560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778949.646458:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790778949.646480:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531602688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778949.646541:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778949.646704:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602688 00000100:00100000:3.0:1790778949.646712:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602688 00000100:00100000:3.0:1790778949.646774:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790778949.646784:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531602688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790778949.646814:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790778949.646862:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531602688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778949.646869:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790778949.646923:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531602688:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790778949.647414:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778949.859614:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778949.860226:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510621696 00000100:00100000:3.0:1790778949.860238:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510621696 00000100:00100000:3.0:1790778949.860322:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:3.0:1790778949.860334:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+13:11196:x1877767510621696:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778949.860364:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778949.860386:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdaf expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860534:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860550:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860572:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860643:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860652:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860659:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860751:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075205 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860760:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075205 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860767:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075205 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778949.860777:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1790778949.860851:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860858:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860872:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860878:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778949.860882:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860890:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860915:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef2363a8b00) 00010000:00010000:3.0:1790778949.860919:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778949.860923:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860930:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560751f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860943:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860949:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860955:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860960:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778949.860962:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860979:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860988:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ef236213700) 00010000:00010000:3.0:1790778949.860991:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778949.860994:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.860999:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560751fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790778949.861228:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778949.862662:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560751f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdaf expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.862690:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075205 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdaf expref: 15 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778949.862699:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:3.0:1790778949.862702:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778949.862705:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:3.0:1790778949.862779:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+15:11196:x1877767510621696:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2447us (3182us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790778949.862788:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:3.0:1790778949.867000:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778949.867123:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510621824 00000100:00100000:1.0:1790778949.867134:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510621824 00000100:00100000:1.0:1790778949.867204:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 140 00000100:00100000:1.0:1790778949.867216:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+15:11196:x1877767510621824:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790778949.867350:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+15:11196:x1877767510621824:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778949.867358:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 140 00000100:00100000:3.0:1790778949.871850:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778949.872216:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510621952 00000100:00100000:2.0:1790778949.872229:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510621952 00000100:00100000:2.0:1790778949.872300:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1790778949.872311:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:2344:x1877767510621952:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778949.872328:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778949.872356:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075205 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdaf expref: 15 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778949.872399:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:2.0:1790778949.872404:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778949.872495:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:2344:x1877767510621952:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 185us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778949.872503:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000040:00080000:2.0:1790778950.030621:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778950.030630:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778950.031193:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1790778950.031205:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790778950.424360:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778951.437373:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778951.529645:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778951.529686:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778951.529817:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778951.529851:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778951.529932:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778951.529974:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622592 00000100:00100000:2.0:1790778951.529984:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622592 00000100:00100000:2.0:1790778951.530061:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622208 00000100:00100000:2.0:1790778951.530064:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622208 00000100:00100000:2.0:1790778951.530087:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:2.0:1790778951.530096:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2343:x1877767510622592:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778951.530172:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2343:x1877767510622592:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778951.530179:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:2.0:1790778951.530210:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:2.0:1790778951.530216:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:2344:x1877767510622208:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778951.530242:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:2344:x1877767510622208:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778951.530248:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00080000:2.0:1790778951.530265:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778951.533573:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622080 00000100:00100000:3.0:1790778951.533588:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622080 00000100:00100000:3.0:1790778951.534880:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 295 00000100:00100000:3.0:1790778951.534913:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510622080:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778951.534983:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510622080:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 77us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778951.534991:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 295 00000100:00100000:1.0:1790778951.543338:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622336 00000100:00100000:1.0:1790778951.543354:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622336 00000100:00100000:1.0:1790778951.543580:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622464 00000100:00100000:1.0:1790778951.543584:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622464 00000100:00100000:0.0:1790778951.543645:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1790778951.543659:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2343:x1877767510622336:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778951.543757:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2343:x1877767510622336:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 102us (14069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778951.543765:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00080000:2.0:1790778951.554805:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790778951.554816:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778951.555483:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1790778951.555499:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510622464:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778951.555607:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+5:2344:x1877767510622464:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 113us (25673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778951.555614:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1790778952.453242:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778952.453316:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622720 00000100:00100000:2.0:1790778952.453327:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622720 00000100:00100000:2.0:1790778952.453393:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00100000:2.0:1790778952.453411:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:11239:x1877767510622720:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778952.453483:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778952.453550:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdb6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453620:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453637:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453651:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453666:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453674:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453680:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453722:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453729:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453749:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453754:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778952.453759:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453767:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453779:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:2.0:1790778952.453783:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778952.453787:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453794:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc8763265607521a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453805:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453811:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453816:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453821:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778952.453823:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453838:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453847:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ef2363a9300) 00010000:00010000:2.0:1790778952.453849:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778952.453852:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453857:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc87632656075221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453888:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075213 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdb6 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453898:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:2.0:1790778952.453900:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778952.453904:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdb6 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.453913:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5e00, rc 0) 00000100:00100000:2.0:1790778952.453973:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:11239:x1877767510622720:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 563us (741us total) trans 0 rc 301/301 00000100:00100000:2.0:1790778952.453980:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 141 00010000:00010000:0.0:1790778952.460684:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778952.478736:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778952.478881:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510622976 00000100:00100000:0.0:1790778952.478896:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510622976 00000100:00100000:0.0:1790778952.478999:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:0.0:1790778952.479014:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+14:11239:x1877767510622976:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:0.0:1790778952.479092:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778952.479119:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656074b75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbe1 expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.479139:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6f00) 00010000:00010000:0.0:1790778952.479151:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778952.479230:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.479246:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.479257:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.479270:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.479276:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.479298:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778952.480833:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790778952.481149:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.481162:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.481174:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.481183:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778952.481191:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.481203:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.481227:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778952.481230:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778952.481236:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.481243:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075228 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778952.481265:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007e3b1558 reply state 00000000d47afa1d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778952.481288:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778952.483330:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+15:11239:x1877767510622976:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 4298us (4586us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1790778952.483354:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 142 00010000:00010000:1.0:1790778952.494052:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.494071:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.494079:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.494085:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778952.494091:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.494098:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.494115:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ef235cc0300) 00010000:00010000:1.0:1790778952.494118:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778952.494122:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.494127:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607522f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778952.686323:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778952.691710:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510623104 00000100:00100000:0.0:1790778952.691729:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510623104 00000100:00100000:2.0:1790778952.694887:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00100000:2.0:1790778952.694905:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+14:11247:x1877767510623104:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:2.0:1790778952.694968:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778952.694993:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdbd expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.695067:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc8763265607523d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.695083:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc8763265607523d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.695095:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc8763265607523d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778952.695857:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790778952.695866:0:5950:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778952.696083:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc8763265607523d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.696133:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdbd expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.696373:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc8763265607523d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdbd expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.696393:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:2.0:1790778952.697389:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790778952.697618:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4600, rc 0) 00000100:00100000:2.0:1790778952.697707:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+15:11247:x1877767510623104:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 2802us (11390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778952.697717:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00100000:0.0:1790778952.719699:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531602944:0@lo:400:kworker.0 00000100:00100000:0.0:1790778952.719823:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778952.719983:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531603456:0@lo:400:kworker.0 00000100:00100000:0.0:1790778952.720038:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778952.720132:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778952.720393:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531603072:0@lo:400:kworker.0 00000100:00100000:0.0:1790778952.720491:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778952.720582:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531603456 00000100:00100000:0.0:1790778952.720596:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531603456 00000100:00100000:0.0:1790778952.720697:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790778952.720714:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778952.720814:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531603456:12345-0@lo:400:kworker.0 Request processed in 106us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778952.720821:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790778952.720851:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602944 00000100:00100000:0.0:1790778952.720857:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602944 00000100:00100000:0.0:1790778952.720906:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531603072 00000100:00100000:0.0:1790778952.720914:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531603072 00000100:00100000:1.0:1790778952.721694:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531603200:0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.721738:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778952.721797:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790778952.721807:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531602816:0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.721837:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778952.721862:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531603328:0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.721887:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778952.721917:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531603200 00000100:00100000:1.0:1790778952.721923:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531603200 00000100:00100000:1.0:1790778952.721968:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790778952.721977:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531603200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.722018:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531603200:12345-0@lo:400:kworker.0 Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.722028:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790778952.722051:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531602816 00000100:00100000:1.0:1790778952.722055:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531602816 00000100:00100000:1.0:1790778952.722078:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790778952.722084:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531602816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.722113:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531602816:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.722121:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790778952.722360:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531602816:0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.722376:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531603200:0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.722474:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531603456:0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.722522:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531603328 00000100:00100000:1.0:1790778952.722526:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531603328 00000100:00080000:2.0:1790778952.722616:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790778952.722621:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778952.722635:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790778952.724883:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790778952.724965:0:5951:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790778952.724978:0:5951:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790778952.725170:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790778952.725184:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531603328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778952.725345:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531603328:12345-0@lo:400:kworker.0 Request processed in 164us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.725356:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790778952.725783:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531603328:0@lo:400:kworker.0 00000100:00080000:3.0:1790778952.726618:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778952.733709:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531602944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778952.733942:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531602944:12345-0@lo:400:kworker.0 Request processed in 11297us (14119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778952.733957:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790778952.734522:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531602944:0@lo:400:kworker.0 00000100:00100000:0.0:1790778952.738654:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531603072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778952.738785:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531603072:12345-0@lo:400:kworker.0 Request processed in 13890us (18295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778952.738795:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790778952.738905:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531603072:0@lo:400:kworker.0 00000100:00100000:3.0:1790778952.815034:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778952.815214:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510623232 00000100:00100000:1.0:1790778952.815229:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510623232 00000100:00100000:1.0:1790778952.815344:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 144 00000100:00100000:1.0:1790778952.815362:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+15:11253:x1877767510623232:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778952.815904:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778952.815929:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdc4 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816012:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816032:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816043:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816075:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816083:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816090:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816182:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816191:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816197:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778952.816244:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790778952.816248:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778952.816266:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816278:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816286:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816293:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816309:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778952.816314:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816323:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816340:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:1.0:1790778952.816346:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778952.816355:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816364:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607524b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.816388:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817059:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817066:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817072:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778952.817075:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817082:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817103:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ef22051fb00) 00010000:00010000:1.0:1790778952.817106:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778952.817109:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817115:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075252 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817154:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdc4 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817168:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdc4 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.817174:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778952.817176:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790778952.817179:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387400, rc 0) 00000100:00100000:1.0:1790778952.817251:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+16:11253:x1877767510623232:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1893us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.817260:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 144 00000100:00100000:0.0:1790778952.833285:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778952.833796:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510623488 00000100:00100000:3.0:1790778952.833808:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510623488 00000100:00100000:3.0:1790778952.833887:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00100000:3.0:1790778952.833900:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+16:11253:x1877767510623488:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790778952.834051:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778952.834211:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656075260 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdcb expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.834337:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.835248:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.835262:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.835326:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.835350:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.836026:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790778952.839400:0:7119:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1790778952.839766:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839790:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839806:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839871:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839880:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839888:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839893:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778952.839898:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.839906:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.840411:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:3.0:1790778952.840415:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778952.840421:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.840428:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790778952.840493:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000238da04c reply state 000000009676c8cf transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778952.840505:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790778952.840563:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656075260 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 19 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.840582:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 18 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.840590:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:3.0:1790778952.840593:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778952.840595:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aac00, rc 0) 00000100:00100000:3.0:1790778952.840798:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+19:11253:x1877767510623488:12345-192.168.202.2@tcp:101:bash.0 Request processed in 6900us (7523us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790778952.840809:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 145 00010000:00010000:0.0:1790778952.846264:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.846292:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.846304:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.846313:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778952.846321:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.846333:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.846359:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef236213700) 00010000:00010000:0.0:1790778952.846364:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778952.846372:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778952.846382:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607526e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778952.846980:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778952.848278:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510623616 00000100:00100000:3.0:1790778952.848292:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510623616 00000100:00100000:3.0:1790778952.848357:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1790778952.848367:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510623616:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790778952.848404:0:12307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778952.848427:0:12307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdd2 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778952.848471:0:12307:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790778952.848492:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1790778952.848497:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778952.848507:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 6 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.848538:0:12307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 6 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778952.848552:0:12307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:0.0:1790778952.848713:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510623616:12345-192.168.202.2@tcp:101:bash.0 Request processed in 341us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778952.848741:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1790778952.860865:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778952.861155:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510623744 00000100:00100000:1.0:1790778952.861169:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510623744 00000100:00100000:1.0:1790778952.861285:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:1.0:1790778952.861302:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+6:11253:x1877767510623744:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778952.861333:0:6935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778952.861358:0:6935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdd9 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.861699:0:6935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.861711:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778952.861716:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778952.861722:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 7 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.861759:0:6935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.861773:0:6935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778952.861790:0:6935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6935:1877767531603584:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778952.861890:0:6935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369180 going to sleep for 11 seconds 00000100:00100000:1.0:1790778952.869068:0:6935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6935:1877767531603584:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778952.869121:0:6935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 7 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.869148:0:6935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386a00, rc 0) 00000100:00100000:1.0:1790778952.869245:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:11253:x1877767510623744:12345-192.168.202.2@tcp:101:bash.0 Request processed in 7949us (8391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.869254:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:2.0:1790778952.872001:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778952.872270:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510623872 00000100:00100000:1.0:1790778952.872282:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510623872 00010000:00010000:1.0:1790778952.872330:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778952.872380:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1790778952.872390:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510623872:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778952.872419:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778952.872478:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.872492:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.872520:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075283 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd2 expref: 7 pid: 12307 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.872550:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778952.872554:0:5933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778952.872563:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 6 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.872580:0:5933:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 6 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778952.872623:0:5933:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 6 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778952.872662:0:5933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5933:1877767531603712:192.168.202.2@tcp:105: 00000100:00100000:1.0:1790778952.872762:0:5933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369180 going to sleep for 11 seconds 00000100:00100000:0.0:1790778952.882961:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778952.883179:0:5933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5933:1877767531603712:192.168.202.2@tcp:105: 00010000:00010000:1.0:1790778952.883208:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778952.883271:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510623872:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 10881us (11279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778952.883283:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1790778952.887709:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510624128 00000100:00100000:2.0:1790778952.887725:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510624128 00000100:00100000:2.0:1790778952.887843:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1790778952.887854:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:11253:x1877767510624128:12345-192.168.202.2@tcp:35:bash.0 00000001:00080000:2.0:1790778952.888107:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:2.0:1790778952.888234:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:11253:x1877767510624128:12345-192.168.202.2@tcp:35:bash.0 Request processed in 381us (5282us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1790778952.888242:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000020:00080000:2.0:1790778952.888248:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790778952.970897:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778952.972232:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510624384 00000100:00100000:2.0:1790778952.972246:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510624384 00000100:00100000:2.0:1790778952.972319:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:2.0:1790778952.972330:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+20:11263:x1877767510624384:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778952.972357:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778952.972380:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcde0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778952.972503:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790778952.972619:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075291 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcde0 expref: 22 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.972659:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:2.0:1790778952.972662:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790778952.972667:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcde0 expref: 22 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778952.972682:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5600, rc 0) 00000100:00100000:2.0:1790778952.972757:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:11263:x1877767510624384:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 429us (1877us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1790778952.972765:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:3.0:1790778952.975371:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778952.975572:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510624640 00000100:00100000:0.0:1790778952.975583:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510624640 00000100:00100000:0.0:1790778952.975643:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1790778952.975655:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:11263:x1877767510624640:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778952.976011:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+22:11263:x1877767510624640:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 357us (652us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1790778952.976019:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1790778953.060796:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.060906:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510624768 00000100:00100000:1.0:1790778953.060928:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510624768 00000100:00100000:1.0:1790778953.060999:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:1.0:1790778953.061011:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+22:11269:x1877767510624768:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778953.061053:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778953.061085:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc8763265607529f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcde7 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.061174:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc876326560752a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.061194:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc876326560752a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.061211:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc876326560752a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778953.061261:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790778953.061265:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778953.061325:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc876326560752a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.061357:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc8763265607529f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcde7 expref: 24 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.061380:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc876326560752a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcde7 expref: 23 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.061390:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778953.061394:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778953.061398:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386800, rc 0) 00000100:00100000:1.0:1790778953.061554:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+23:11269:x1877767510624768:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 545us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.061563:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00080000:3.0:1790778953.061909:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778953.069213:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.069775:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510625024 00000100:00100000:0.0:1790778953.069786:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510625024 00000100:00100000:0.0:1790778953.069867:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:0.0:1790778953.069878:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+23:11269:x1877767510625024:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778953.069905:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778953.069990:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560752ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdee expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.070128:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560752b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.070205:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560752b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.070219:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560752b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778953.070247:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790778953.070499:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560752ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdee expref: 26 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.070520:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560752b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdee expref: 25 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.070541:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:0.0:1790778953.070544:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778953.070547:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0800, rc 0) 00000100:00100000:0.0:1790778953.070751:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+25:11269:x1877767510625024:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 874us (1558us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790778953.070759:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:3.0:1790778953.075249:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778953.075383:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.075476:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510625408 00000100:00100000:2.0:1790778953.075487:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510625408 00000100:00100000:2.0:1790778953.075565:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790778953.075575:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+25:2344:x1877767510625408:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778953.075593:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778953.075624:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560752b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdee expref: 25 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.075647:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:2.0:1790778953.075653:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778953.075730:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+24:2344:x1877767510625408:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 157us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.075739:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1790778953.077656:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510625280 00000100:00100000:1.0:1790778953.077676:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510625280 00000100:00100000:1.0:1790778953.077781:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 149 00000100:00100000:1.0:1790778953.077793:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+24:11269:x1877767510625280:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778953.077824:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778953.077853:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc876326560752c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdf5 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.078011:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.078384:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.078402:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778953.078562:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790778953.078719:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc876326560752c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdf5 expref: 27 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.078743:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdf5 expref: 26 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.078755:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:1.0:1790778953.078757:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790778953.078761:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387800, rc 0) 00000100:00100000:1.0:1790778953.078917:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+26:11269:x1877767510625280:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1126us (3678us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1790778953.078927:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 149 00000100:00100000:3.0:1790778953.087055:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.087245:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510625536 00000100:00100000:0.0:1790778953.087255:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510625536 00000100:00100000:0.0:1790778953.087335:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1790778953.087346:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+6:2346:x1877767510625536:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:0.0:1790778953.087392:0:6937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.087414:0:6937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 6 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.087423:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778953.087427:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778953.087432:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.087512:0:6937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 6 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.087536:0:6937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 6 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778953.087553:0:6937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6937:1877767531603840:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778953.087647:0:6937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8d80 going to sleep for 11 seconds 00000100:00080000:3.0:1790778953.088305:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778953.092244:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.092402:0:6937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6937:1877767531603840:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778953.092438:0:6937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.092598:0:6942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510625664 00000100:00100000:3.0:1790778953.092606:0:6942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510625664 00002000:00100000:3.0:1790778953.092660:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ef2369bb800 x1877767510625664/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:504/0 lens 504/0 e 0 to 0 dl 1790778964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790778953.092672:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2369bb800 with x1877767510625664 ext(0->12) 00010000:00010000:3.0:1790778953.092681:0:6942:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 7 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.092711:0:6942:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 7 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778953.092719:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef2369bb800 00000100:00100000:3.0:1790778953.092759:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1790778953.092769:0:6942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510625664:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:3.0:1790778953.094905:0:6942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510625664:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 2127us (2664us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790778953.094929:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00002000:00100000:3.0:1790778953.094943:0:6942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ef2369bb800 x1877767510625664/t4294967305(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:504/0 lens 504/448 e 0 to 0 dl 1790778964 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790778953.094953:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2369bb800 with x1877767510625664 ext(0->12) 00010000:00010000:3.0:1790778953.094964:0:6942:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 9 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.094984:0:6942:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 9 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778953.094992:0:6942:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef2369bb800 00000100:00100000:2.0:1790778953.099042:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.099148:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510625792 00000100:00100000:1.0:1790778953.099159:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510625792 00010000:00010000:1.0:1790778953.099199:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 9 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.099246:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1790778953.099255:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2346:x1877767510625792:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778953.099281:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790778953.099318:0:5935:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790778953.099321:0:5935:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790778953 00002000:00010000:1.0:1790778953.099323:0:5935:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790778953 00002000:00010000:1.0:1790778953.099325:0:5935:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790778953 00002000:00010000:1.0:1790778953.099327:0:5935:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790778953.099334:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 9 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.099347:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 9 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.099370:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671e6a92/0xdc8763265607528a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdd9 expref: 9 pid: 6935 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.099386:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778953.099391:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778953.099396:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.099406:0:5935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.099494:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778953.099556:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510625792:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 301us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.099563:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00010000:00010000:0.0:1790778953.100303:0:6937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100318:0:6937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100344:0:6937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100353:0:6937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100362:0:6937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100370:0:6937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790778953.100386:0:6937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100397:0:6937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100412:0:6937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.100420:0:6937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed330ac6/0xdc876326560752d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778953.100522:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510625536:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 13177us (13475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778953.100544:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1790778953.104726:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.104803:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510626048 00000100:00100000:1.0:1790778953.104830:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510626048 00000100:00100000:1.0:1790778953.104892:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1790778953.104904:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+26:11269:x1877767510626048:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:1.0:1790778953.104978:0:5953:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdf5 expref: 26 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790778953.105189:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1790778953.105218:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1790778953.105577:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1790778953.105612:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.105628:0:5953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 30 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.105637:0:5953:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.105672:0:5953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 30 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.105688:0:5953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 30 pid: 7119 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.105703:0:5953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5953:1877767531603968:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778953.105798:0:5953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778953.110732:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.110823:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510626176 00000100:00100000:2.0:1790778953.110834:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510626176 00010000:00010000:2.0:1790778953.110890:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 31 pid: 7119 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.110937:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:2.0:1790778953.110947:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+31:2345:x1877767510626176:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778953.110964:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778953.110970:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 31 pid: 7119 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.110983:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 31 pid: 7119 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.111013:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:2.0:1790778953.111020:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.111031:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.111039:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.111061:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778953.111432:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+31:2345:x1877767510626176:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 485us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.111483:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00010000:00010000:1.0:1790778953.111775:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdcb expref: 30 pid: 7119 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.111807:0:5953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5953:1877767531603968:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778953.111832:0:5953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.111841:0:5953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.111848:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790778953.111965:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1790778953.112071:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790778953.112338:0:5953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531604096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790778953.112399:0:5953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778953.112439:0:5953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369300 going to sleep for 11 seconds 00000100:00100000:2.0:1790778953.112725:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531604096 00000100:00100000:2.0:1790778953.112733:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531604096 00000100:00100000:2.0:1790778953.112799:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790778953.112822:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5953:x1877767531604096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790778953.112931:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5953:x1877767531604096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.112939:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790778953.113383:0:5953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2368fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531604096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790778953.113576:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1790778953.113638:0:5953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23684d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531604224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790778953.113675:0:5953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778953.113692:0:5953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778953.113933:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531604224 00000100:00100000:2.0:1790778953.113940:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531604224 00000100:00100000:2.0:1790778953.113975:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790778953.113983:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5953:x1877767531604224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790778953.114403:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5953:x1877767531604224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 420us (726us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790778953.114411:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790778953.114536:0:5953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23684d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5953:1877767531604224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790778953.114585:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790778953.114624:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.114635:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.114657:0:5953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.114664:0:5953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778953.114668:0:5953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.114678:0:5953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.114696:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:1.0:1790778953.114699:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790778953.114704:0:5953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.114710:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc876326560752de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790778953.114810:0:5953:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790778953.114872:0:5953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1790778953.114886:0:5953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346990442928ns, next at 347990440041ns, rc = 0 00000001:00080000:1.0:1790778953.114892:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1790778953.114913:0:5953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef236213500) 00010000:00010000:1.0:1790778953.114996:0:5953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790778953.115004:0:5953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdf5 expref: 34 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.115349:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:11269:x1877767510626048:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 10366us (10553us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1790778953.115374:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000020:00080000:1.0:1790778953.115379:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790778953.118201:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.118694:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510626304 00000100:00100000:2.0:1790778953.118708:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510626304 00000100:00100000:2.0:1790778953.118786:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:2.0:1790778953.118799:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:11269:x1877767510626304:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778953.118831:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778953.118861:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc876326560752e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcdfc expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.118936:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc876326560752e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdfc expref: 34 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.118951:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc876326560752e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdfc expref: 34 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.118971:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:2.0:1790778953.118975:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778953.118988:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5200, rc 0) 00000100:00100000:2.0:1790778953.119065:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+34:11269:x1877767510626304:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 269us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.119073:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:2.0:1790778953.123859:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.123984:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510626560 00000100:00100000:0.0:1790778953.123999:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510626560 00000100:00100000:0.0:1790778953.124079:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1790778953.124090:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+34:11269:x1877767510626560:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778953.124435:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:11269:x1877767510626560:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 345us (587us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1790778953.124491:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1790778953.222586:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.222700:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510626816 00000100:00100000:0.0:1790778953.222713:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510626816 00000100:00100000:0.0:1790778953.222783:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:0.0:1790778953.222812:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+35:11279:x1877767510626816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778953.222842:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778953.222864:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560752ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce03 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778953.222992:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790778953.223129:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560752ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce03 expref: 37 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.223146:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:0.0:1790778953.223150:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778953.223156:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560752ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce03 expref: 37 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.223172:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1200, rc 0) 00000100:00100000:0.0:1790778953.223255:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+36:11279:x1877767510626816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 445us (681us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1790778953.223262:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:3.0:1790778953.228404:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.228737:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510626944 00000100:00100000:1.0:1790778953.228748:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510626944 00000100:00100000:1.0:1790778953.228821:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:1.0:1790778953.228832:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+36:11279:x1877767510626944:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1790778953.228928:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.228947:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.228959:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.228975:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.228982:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.228989:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229308:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229319:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229346:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778953.229403:0:12797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229419:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229427:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229434:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229477:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778953.229483:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229491:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229506:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778953.229509:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778953.229516:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229522:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc876326560752fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229547:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229559:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229564:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229569:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778953.229572:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229578:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229587:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef22051fb00) 00010000:00010000:1.0:1790778953.229590:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778953.229592:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229598:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229613:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229619:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229626:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229631:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778953.229639:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229646:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229654:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778953.229657:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778953.229660:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.229667:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.229775:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+36:11279:x1877767510626944:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 942us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.229783:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:2.0:1790778953.233198:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.233316:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510627200 00000100:00100000:0.0:1790778953.233329:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510627200 00000100:00100000:0.0:1790778953.233391:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:0.0:1790778953.233402:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:11279:x1877767510627200:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778953.233733:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+37:11279:x1877767510627200:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 332us (550us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790778953.233742:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:0.0:1790778953.284744:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778953.284861:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510627456 00000100:00100000:3.0:1790778953.284874:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510627456 00000100:00100000:3.0:1790778953.284949:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:3.0:1790778953.284968:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+37:11282:x1877767510627456:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778953.285003:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778953.285239:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc8763265607530f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce0a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285405:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285421:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285433:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285494:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285503:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285510:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285651:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285660:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285666:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778953.285688:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790778953.285782:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285790:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285797:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285802:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778953.285807:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285814:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285825:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:3.0:1790778953.285828:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778953.285833:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285839:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285854:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285860:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285874:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285879:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778953.285882:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285887:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285894:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef236213e00) 00010000:00010000:3.0:1790778953.285896:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778953.285899:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285904:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607531d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285969:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc8763265607530f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 40 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285982:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 39 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.285989:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778953.285991:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778953.285994:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aac00, rc 0) 00000100:00100000:3.0:1790778953.286631:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+39:11282:x1877767510627456:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1663us (1900us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1790778953.286654:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:3.0:1790778953.291542:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.291792:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510627584 00000100:00100000:1.0:1790778953.291807:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510627584 00000100:00100000:1.0:1790778953.291873:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:1.0:1790778953.291885:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+39:11282:x1877767510627584:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1790778953.291979:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.291998:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292010:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292070:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292094:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292102:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292109:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778953.292116:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292125:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292139:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778953.292142:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790778953.292147:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.292155:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.292243:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+39:11282:x1877767510627584:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 360us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.292251:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:0.0:1790778953.299294:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.299486:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510627840 00000100:00100000:1.0:1790778953.299498:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510627840 00000100:00100000:1.0:1790778953.299576:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1790778953.299587:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+39:11282:x1877767510627840:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1790778953.299888:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+40:11282:x1877767510627840:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 302us (602us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790778953.299916:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00010000:00010000:2.0:1790778953.484300:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778953.609760:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.609884:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510628096 00000100:00100000:1.0:1790778953.609895:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510628096 00000100:00100000:1.0:1790778953.609969:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 155 00000100:00100000:1.0:1790778953.609979:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+40:11313:x1877767510628096:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1790778953.610012:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778953.610048:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce11 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.610174:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.610192:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.610206:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778953.610220:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790778953.610342:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc87632656075339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce11 expref: 43 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.610364:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce11 expref: 42 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.610373:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778953.610376:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778953.610380:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386a00, rc 0) 00000100:00100000:1.0:1790778953.610518:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+42:11313:x1877767510628096:12345-192.168.202.2@tcp:101:cat.0 Request processed in 540us (767us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1790778953.610534:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 155 00000100:00100000:3.0:1790778953.616928:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.618494:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510628352 00000100:00100000:1.0:1790778953.618511:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510628352 00000100:00100000:1.0:1790778953.618600:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1790778953.618610:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+42:11313:x1877767510628352:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:1.0:1790778953.619278:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+43:11313:x1877767510628352:12345-192.168.202.2@tcp:35:cat.0 Request processed in 666us (2373us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1790778953.619288:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1790778953.621351:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778953.621570:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510628480 00000100:00100000:1.0:1790778953.621586:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510628480 00000100:00100000:1.0:1790778953.621671:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1790778953.621682:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+43:2343:x1877767510628480:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778953.621705:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778953.621740:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce11 expref: 43 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.621764:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778953.621770:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778953.621833:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+42:2343:x1877767510628480:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 154us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778953.621842:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790778953.687246:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.687367:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510628736 00000100:00100000:2.0:1790778953.687378:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510628736 00000100:00100000:2.0:1790778953.687499:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:2.0:1790778953.687512:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+42:11319:x1877767510628736:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:2.0:1790778953.687553:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778953.687558:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790778953.687587:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc876326560752a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcde7 expref: 42 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.687608:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:2.0:1790778953.687614:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778953.687630:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607534e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce18 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.687774:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.687792:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 42 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.687802:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.687866:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 42 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.687882:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 42 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.687899:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531604352:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778953.688046:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778953.692274:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531604352:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778953.692315:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.693345:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.693745:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510628864 00000100:00100000:0.0:1790778953.693755:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510628864 00010000:00010000:0.0:1790778953.693799:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 43 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778953.693842:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:0.0:1790778953.693852:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+43:2345:x1877767510628864:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778953.693869:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778953.693877:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 43 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.693890:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 43 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.693923:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce0a expref: 43 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.693942:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778953.693947:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.693958:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.693965:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.694018:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778953.694133:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+42:2345:x1877767510628864:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 282us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778953.694142:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00010000:00010000:3.0:1790778953.694205:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.694215:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778953.694234:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790778953.694368:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607534e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 43 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.694385:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 42 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.694392:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778953.694396:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790778953.694398:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4e00, rc 0) 00000100:00100000:3.0:1790778953.694424:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+42:11319:x1877767510628736:12345-192.168.202.2@tcp:101:dd.0 Request processed in 6916us (7189us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1790778953.694432:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:0.0:1790778953.698325:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.698497:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510628992 00000100:00100000:2.0:1790778953.698509:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510628992 00000100:00100000:2.0:1790778953.698585:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:2.0:1790778953.698599:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+42:11319:x1877767510628992:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:2.0:1790778953.698634:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778953.698663:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075363 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce1f expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.698711:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.698730:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.698743:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.698940:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075363 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 44 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.698964:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 43 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.698974:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:2.0:1790778953.698977:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790778953.698981:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4200, rc 0) 00000100:00100000:2.0:1790778953.699068:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+43:11319:x1877767510628992:12345-192.168.202.2@tcp:101:dd.0 Request processed in 471us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.699076:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:1.0:1790778953.704821:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778953.705186:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510629248 00000100:00100000:0.0:1790778953.705200:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510629248 00000100:00100000:0.0:1790778953.705281:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:0.0:1790778953.705292:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+43:11319:x1877767510629248:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:0.0:1790778953.705868:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.705890:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.705905:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790778953.705966:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1790778953.705989:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002894a0e3 reply state 00000000635a34aa transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778953.705997:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778953.706151:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+46:11319:x1877767510629248:12345-192.168.202.2@tcp:36:dd.0 Request processed in 859us (1341us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1790778953.706159:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 158 00000020:00080000:0.0:1790778953.706165:0:7119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790778953.709185:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.709236:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.709243:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.709251:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778953.709257:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.709266:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.709289:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778953.709292:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778953.709298:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778953.709303:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc87632656075371 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778953.950602:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778953.950717:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510629376 00000100:00100000:3.0:1790778953.950728:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510629376 00000100:00100000:3.0:1790778953.950800:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:3.0:1790778953.950812:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+45:11333:x1877767510629376:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:3.0:1790778953.950860:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778953.950885:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656075378 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce26 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951380:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951399:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951412:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951427:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951433:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951482:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951590:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951603:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 46 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951613:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951661:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 46 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778953.951692:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 46 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.951710:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531604480:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778953.951869:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778953.956370:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531604480:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778953.956402:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778953.957555:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.957631:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510629632 00000100:00100000:2.0:1790778953.957640:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510629632 00000100:00100000:2.0:1790778953.957707:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1790778953.957718:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+47:9033:x1877767510629632:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790778953.958318:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+48:9033:x1877767510629632:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 600us (2398us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1790778953.958327:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:1.0:1790778953.963207:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778953.963372:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510629760 00000100:00100000:2.0:1790778953.963383:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510629760 00010000:00010000:2.0:1790778953.963486:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 48 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778953.963538:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:2.0:1790778953.963548:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+48:2345:x1877767510629760:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778953.963567:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778953.963575:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 48 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.963598:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 48 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.963830:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075355 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce18 expref: 48 pid: 5949 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.963856:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:2.0:1790778953.963863:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.963875:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.963886:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778953.963947:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778953.964085:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+47:2345:x1877767510629760:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 536us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778953.964094:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00010000:00010000:0.0:1790778953.964262:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964282:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778953.964346:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790778953.964352:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778953.964377:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964390:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964400:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964407:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964413:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964419:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778953.964423:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964432:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964506:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778953.964510:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778953.964515:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964540:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607537f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964554:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964561:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964568:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964572:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778953.964575:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964582:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964589:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef236213e00) 00010000:00010000:0.0:1790778953.964592:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778953.964596:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964602:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc87632656075386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964653:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc87632656075378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce26 expref: 47 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964668:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce26 expref: 46 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778953.964682:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778953.964685:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778953.964688:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:0.0:1790778953.964730:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+46:11333:x1877767510629376:12345-192.168.202.2@tcp:101:stat.0 Request processed in 13921us (14140us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778953.964737:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:1.0:1790778954.006691:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.006793:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510630016 00000100:00100000:2.0:1790778954.006802:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510630016 00000100:00100000:2.0:1790778954.006892:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 160 00000100:00100000:2.0:1790778954.006901:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+46:11339:x1877767510630016:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:2.0:1790778954.006961:0:12797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778954.006989:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc8763265607538d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce26 expref: 46 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.007007:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:2.0:1790778954.007011:0:12797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778954.007485:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.007502:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.007514:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778954.007678:0:12797:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1790778954.007713:0:12797:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000811963c2 reply state 00000000d99af4bb transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778954.007723:0:12797:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778954.007892:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+48:11339:x1877767510630016:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 989us (1209us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1790778954.007901:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 160 00000020:00080000:2.0:1790778954.007907:0:12797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790778954.014021:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.014047:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.014056:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.014062:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.014068:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.014077:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.014096:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.014100:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.014106:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.014114:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778954.014844:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:2.0:1790778954.014874:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790778954.015248:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef207d3c0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1790778954.015255:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef235cf6900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef207d3c300 00000020:00080000:2.0:1790778954.015258:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef235cf6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2364f0e00 00000100:00100000:1.0:1790778954.015438:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531604608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790778954.015594:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790778954.015863:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1790778954.016026:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531604608 00000100:00100000:2.0:1790778954.016050:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531604608 00000020:00080000:0.0:1790778954.016545:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1790778954.016676:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790778954.016690:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3440:x1877767531604608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790778954.016735:0:6934:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1790778954.016787:0:6934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd1e49, atime: 0x6abd1e49, ctime: 0x6abd1e49, blocks: 0x8 00010000:00010000:2.0:1790778954.016810:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.016839:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1790778954.016845:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778954.016855:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.016878:0:6934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.016891:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.016900:0:6934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.016931:0:6934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790778954.017144:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3440:x1877767531604608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 447us (1541us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790778954.017152:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790778954.017183:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790778954.017539:0:3440:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef2369b9880/2, rc 0, transno 4294967307 00000100:00100000:3.0:1790778954.017548:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531604608:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790778954.017789:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778954.017809:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.017819:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790778954.017823:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.017833:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.017850:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.017858:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f379ec4/0xdc8763265607539b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.017883:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778954.017885:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778954.017886:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778954.169813:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.170069:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510630144 00000100:00100000:0.0:1790778954.170080:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510630144 00000100:00100000:0.0:1790778954.170157:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00100000:0.0:1790778954.170169:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+17:11353:x1877767510630144:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:0.0:1790778954.170218:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778954.170239:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce2d expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170326:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170343:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170356:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170372:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170380:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170686:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170760:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170770:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170778:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778954.170820:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790778954.170831:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778954.170856:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170869:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170877:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170883:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170890:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.170896:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.170900:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171101:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171116:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778954.171120:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.171124:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171490:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560753a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171506:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171534:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171540:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171545:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.171549:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171556:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171564:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778954.171567:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.171570:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171575:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171659:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 19 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171675:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 18 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.171684:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.171686:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778954.171696:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0600, rc 0) 00000100:00100000:0.0:1790778954.171827:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:11353:x1877767510630144:12345-192.168.202.2@tcp:101:stat.0 Request processed in 1660us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.171836:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00100000:1.0:1790778954.266709:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.266982:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510630400 00000100:00100000:0.0:1790778954.266995:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510630400 00000100:00100000:0.0:1790778954.267085:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:0.0:1790778954.267097:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+18:11363:x1877767510630400:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778954.267124:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778954.267164:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce34 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778954.267300:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790778954.267434:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce34 expref: 20 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.268077:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:0.0:1790778954.268081:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778954.268090:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce34 expref: 20 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.268108:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0a00, rc 0) 00000100:00100000:0.0:1790778954.268377:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:11363:x1877767510630400:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1281us (1678us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1790778954.268387:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:1.0:1790778954.277037:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.277168:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510630656 00000100:00100000:0.0:1790778954.277177:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510630656 00000100:00100000:0.0:1790778954.277225:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:0.0:1790778954.277242:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:11363:x1877767510630656:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778954.277481:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+20:11363:x1877767510630656:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 240us (454us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1790778954.277489:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1790778954.333282:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.333346:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510630912 00000100:00100000:2.0:1790778954.333356:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510630912 00000100:00100000:2.0:1790778954.333420:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:2.0:1790778954.333432:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+20:11369:x1877767510630912:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778954.333507:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778954.333543:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560753cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce3b expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.333664:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.333679:0:12797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 21 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.333688:0:12797:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.333722:0:12797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 21 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.333735:0:12797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 21 pid: 7119 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778954.333750:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531604736:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778954.333917:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790778954.338113:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.338222:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510631040 00000100:00100000:0.0:1790778954.338230:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510631040 00000100:00100000:2.0:1790778954.338240:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531604736:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778954.338267:0:12797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338268:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 22 pid: 7119 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778954.338304:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1790778954.338315:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+22:2345:x1877767510631040:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778954.338332:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778954.338339:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 22 pid: 7119 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338352:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 22 pid: 7119 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338374:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce2d expref: 22 pid: 7119 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338391:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.338396:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338406:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338431:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.338506:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778954.338576:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+21:2345:x1877767510631040:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 262us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.338584:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00010000:00010000:1.0:1790778954.338622:0:12797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.338630:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778954.338648:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790778954.338765:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560753cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 22 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.338777:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 21 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.338781:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778954.338783:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778954.338785:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5000, rc 0) 00000100:00100000:1.0:1790778954.338965:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+21:11369:x1877767510630912:12345-192.168.202.2@tcp:101:bash.0 Request processed in 5535us (5690us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1790778954.338972:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:1.0:1790778954.342194:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.342247:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510631296 00000100:00100000:0.0:1790778954.342259:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510631296 00000100:00100000:0.0:1790778954.342326:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 164 00000100:00100000:0.0:1790778954.342337:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+21:11369:x1877767510631296:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:0.0:1790778954.342652:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.342672:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.342686:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790778954.342740:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1790778954.342764:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008a92482c reply state 00000000dfc65954 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778954.342774:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778954.342884:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+24:11369:x1877767510631296:12345-192.168.202.2@tcp:36:bash.0 Request processed in 548us (705us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1790778954.342892:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 164 00000020:00080000:0.0:1790778954.342897:0:7119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790778954.347302:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.347321:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.347329:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.347355:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778954.347360:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.347369:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.347398:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778954.347401:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778954.347406:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.347413:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560753e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778954.348426:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.348489:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510631424 00000100:00100000:0.0:1790778954.348499:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510631424 00000100:00100000:0.0:1790778954.348566:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:0.0:1790778954.348576:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+23:11369:x1877767510631424:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778954.348605:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778954.348625:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce42 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.348716:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.348730:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 24 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.348739:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.348772:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 24 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.348787:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 24 pid: 12797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778954.348802:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531604864:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778954.348890:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790778954.351557:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531604864:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778954.351588:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778954.351990:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.352087:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510631552 00000100:00100000:2.0:1790778954.352095:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510631552 00010000:00010000:2.0:1790778954.352132:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 25 pid: 12797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778954.352215:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1790778954.352227:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+25:2346:x1877767510631552:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778954.352245:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778954.352252:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 25 pid: 12797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.352264:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 25 pid: 12797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.352286:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560753d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce3b expref: 25 pid: 12797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.352303:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:2.0:1790778954.352307:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.352317:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.352325:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.352385:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778954.352529:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.352538:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778954.352587:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+24:2346:x1877767510631552:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 361us (597us total) trans 0 rc 0/0 00000004:00200000:0.0:1790778954.352593:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000100:00100000:2.0:1790778954.352595:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000004:00200000:0.0:1790778954.352597:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778954.352616:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.352645:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc876326560753e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce42 expref: 24 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.352659:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce42 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.352666:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.352669:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778954.352672:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1200, rc 0) 00000100:00100000:0.0:1790778954.353644:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+23:11369:x1877767510631424:12345-192.168.202.2@tcp:101:bash.0 Request processed in 5065us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.353654:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:3.0:1790778954.356965:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.357049:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510631808 00000100:00100000:2.0:1790778954.357060:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510631808 00000100:00100000:2.0:1790778954.357157:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1790778954.357170:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:11369:x1877767510631808:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:2.0:1790778954.357413:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+24:11369:x1877767510631808:12345-192.168.202.2@tcp:35:bash.0 Request processed in 247us (457us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1790778954.357419:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:1.0:1790778954.440571:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.441139:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510632064 00000100:00100000:2.0:1790778954.441150:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510632064 00000100:00100000:3.0:1790778954.441343:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:3.0:1790778954.441355:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+24:11379:x1877767510632064:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778954.441392:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778954.441412:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560753f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce49 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778954.441573:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790778954.441682:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560753f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce49 expref: 26 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.441694:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:3.0:1790778954.441696:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778954.441700:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560753f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce49 expref: 26 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.441710:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790778954.441780:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+25:11379:x1877767510632064:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 429us (1222us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1790778954.441785:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:1.0:1790778954.445078:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.445157:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510632192 00000100:00100000:0.0:1790778954.445170:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510632192 00000100:00100000:0.0:1790778954.445254:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:0.0:1790778954.445269:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+25:11379:x1877767510632192:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1790778954.445574:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445666:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445680:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445696:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445701:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445705:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445858:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445864:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445869:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778954.445910:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445923:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445930:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445950:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445957:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.445962:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445968:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445979:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778954.445982:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.445986:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.445991:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446002:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446007:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446013:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446017:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.446020:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446045:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446053:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778954.446055:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.446059:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446065:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607540b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446080:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446087:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446092:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446098:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.446100:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446105:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446111:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.446113:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.446116:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.446132:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778954.446222:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+25:11379:x1877767510632192:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 955us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.446232:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:0.0:1790778954.450743:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778954.451579:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510632448 00000100:00100000:1.0:1790778954.451591:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510632448 00000100:00100000:1.0:1790778954.451689:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:1.0:1790778954.451700:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+25:11379:x1877767510632448:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1790778954.451944:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+26:11379:x1877767510632448:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 245us (1211us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1790778954.451953:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:1.0:1790778954.492971:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.493135:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510632704 00000100:00100000:0.0:1790778954.493146:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510632704 00000100:00100000:0.0:1790778954.493210:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:0.0:1790778954.493221:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+26:11382:x1877767510632704:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778954.493248:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778954.493270:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce50 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493351:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493366:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493390:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493406:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493413:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493437:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493599:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607542e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493609:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607542e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493617:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607542e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778954.493627:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790778954.493706:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493714:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493720:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493726:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.493730:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493737:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493749:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778954.493753:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.493764:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493771:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493786:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493792:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493798:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493804:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.493807:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493813:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493821:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778954.493824:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.493827:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493833:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493877:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce50 expref: 29 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493903:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607542e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce50 expref: 28 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.493912:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.493914:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778954.493917:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:0.0:1790778954.493986:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:11382:x1877767510632704:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 767us (1025us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1790778954.493994:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:0.0:1790778954.498297:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.499225:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510632960 00000100:00100000:2.0:1790778954.499242:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510632960 00000100:00100000:2.0:1790778954.499371:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1790778954.499394:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+28:2346:x1877767510632960:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778954.499413:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790778954.499435:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:2.0:1790778954.499470:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607542e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce50 expref: 28 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778954.499494:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:2.0:1790778954.499499:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778954.499577:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:2346:x1877767510632960:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 186us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778954.499585:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1790778954.501767:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510632832 00000100:00100000:3.0:1790778954.501779:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510632832 00000100:00100000:3.0:1790778954.501836:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:3.0:1790778954.501845:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+27:11382:x1877767510632832:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1790778954.502190:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502205:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502214:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502243:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502249:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502254:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502258:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778954.502261:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502265:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502287:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778954.502290:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778954.502293:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.502297:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607543c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778954.502362:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+27:11382:x1877767510632832:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 518us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778954.502370:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:1.0:1790778954.505289:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.505798:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510633216 00000100:00100000:2.0:1790778954.505812:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510633216 00000100:00100000:2.0:1790778954.505918:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:2.0:1790778954.505929:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:11382:x1877767510633216:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1790778954.506213:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+28:11382:x1877767510633216:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 285us (991us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790778954.506221:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:0.0:1790778954.507596:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778954.767825:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531604992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790778954.767919:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778954.768100:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531604992 00000100:00100000:1.0:1790778954.768109:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531604992 00000100:00100000:1.0:1790778954.768189:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790778954.768201:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531604992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778954.768242:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1790778954.768306:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531604992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778954.768313:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790778954.768373:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531604992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790778954.768596:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778954.772146:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531605120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778954.772231:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778954.772353:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531605120 00000100:00100000:0.0:1790778954.772362:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531605120 00000100:00100000:0.0:1790778954.772419:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790778954.772429:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531605120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778954.772497:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33972800 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778954.772563:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531605120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.772571:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790778954.772735:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531605120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778954.780248:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778954.780350:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510633472 00000100:00100000:3.0:1790778954.780362:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510633472 00000100:00100000:3.0:1790778954.780425:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:3.0:1790778954.780436:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:11400:x1877767510633472:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1790778954.780504:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778954.780541:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce57 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.780671:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607544a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.780688:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607544a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.780702:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607544a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778954.780726:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790778954.780843:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce57 expref: 31 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.780866:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607544a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce57 expref: 30 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.780877:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778954.780880:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790778954.780884:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790778954.780943:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+30:11400:x1877767510633472:12345-192.168.202.2@tcp:101:cat.0 Request processed in 509us (704us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1790778954.780952:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:3.0:1790778954.825418:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778954.825686:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510633600 00000100:00100000:1.0:1790778954.825698:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510633600 00000100:00100000:1.0:1790778954.825825:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:1.0:1790778954.825838:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+30:11401:x1877767510633600:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778954.825866:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778954.825887:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce5e expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.825959:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607545f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.825975:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607545f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.825987:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607545f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778954.826046:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790778954.826050:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778954.826086:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607545f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.826111:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce5e expref: 32 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.826204:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607545f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce5e expref: 31 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.826215:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778954.826218:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778954.826222:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387600, rc 0) 00000100:00100000:1.0:1790778954.826335:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+31:11401:x1877767510633600:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 500us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778954.826343:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:1.0:1790778954.832603:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778954.832711:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510633984 00000100:00100000:2.0:1790778954.832722:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510633984 00000100:00100000:2.0:1790778954.832779:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:2.0:1790778954.832789:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:11401:x1877767510633984:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1790778954.833220:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+32:11401:x1877767510633984:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 431us (625us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790778954.833228:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1790778954.838535:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778954.838676:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510634112 00000100:00100000:3.0:1790778954.838687:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510634112 00000100:00100000:3.0:1790778954.838758:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790778954.838769:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+32:11401:x1877767510634112:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:3.0:1790778954.838786:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790778954.838814:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560753ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce42 expref: 32 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.838837:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc8763265607544a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce57 expref: 31 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.838851:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc876326560752e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdfc expref: 30 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778954.838881:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778954.838887:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778954.838979:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+29:11401:x1877767510634112:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 212us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778954.838987:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790778954.844355:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778954.844594:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510634240 00000100:00100000:1.0:1790778954.844604:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510634240 00000100:00100000:1.0:1790778954.844666:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:1.0:1790778954.844678:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+29:11401:x1877767510634240:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:1.0:1790778954.844824:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.844846:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778954.844860:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790778954.844989:0:12797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790778954.845087:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+29:11401:x1877767510634240:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 410us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778954.845095:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:1.0:1790778954.882886:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778954.883077:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510634368 00000100:00100000:0.0:1790778954.883091:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510634368 00000100:00100000:0.0:1790778954.883229:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:0.0:1790778954.883241:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+29:11403:x1877767510634368:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778954.883291:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778954.883319:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607546d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce65 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883392:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883408:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883420:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883435:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883563:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883571:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883657:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883667:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883675:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778954.883732:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790778954.883743:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778954.883766:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883778:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883788:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883795:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883803:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883810:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.883815:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883823:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883836:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778954.883839:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.883844:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883850:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883865:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883880:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883886:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883892:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778954.883895:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883916:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883925:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778954.883928:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778954.883931:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883936:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607547b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883970:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc8763265607546d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 31 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883985:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 30 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778954.883993:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778954.883995:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778954.884004:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:0.0:1790778954.884090:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:11403:x1877767510634368:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 851us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778954.884099:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 173 00000040:00080000:3.0:1790778955.147757:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790778955.147771:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790778955.147805:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790778955.147818:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790778955.148009:0:12077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531605248:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790778955.148213:0:12077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905240 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.151719:0:12077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2330ece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531605248:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790778955.152392:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.155782:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510634496 00000100:00100000:1.0:1790778955.155811:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510634496 00000100:00100000:1.0:1790778955.155954:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:1.0:1790778955.155970:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+30:11414:x1877767510634496:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790778955.156023:0:5951:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790778955.156355:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+30:11414:x1877767510634496:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 389us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.156366:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00080000:2.0:1790778955.156494:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778955.160261:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.160333:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510634624 00000100:00100000:3.0:1790778955.160344:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510634624 00000100:00100000:3.0:1790778955.160409:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:3.0:1790778955.160420:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+30:11414:x1877767510634624:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790778955.160690:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160721:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160738:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160820:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160830:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160839:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160870:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160879:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160886:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778955.160936:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790778955.160941:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778955.160953:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160978:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160985:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.160992:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161010:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778955.161014:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161022:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161034:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:3.0:1790778955.161038:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778955.161042:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161049:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc87632656075489 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161065:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161072:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161078:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161083:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778955.161085:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161091:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161107:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778955.161109:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778955.161112:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161118:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075490 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161132:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161138:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161144:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161149:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778955.161152:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161157:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161165:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778955.161167:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778955.161170:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.161176:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc87632656075497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.161265:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+30:11414:x1877767510634624:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 846us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.161273:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:2.0:1790778955.165381:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.165565:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510634880 00000100:00100000:0.0:1790778955.165578:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510634880 00000100:00100000:0.0:1790778955.165656:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:0.0:1790778955.165667:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+30:11414:x1877767510634880:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.165708:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778955.165731:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607549e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce6c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.165849:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.165863:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.165873:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778955.165881:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790778955.165968:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.165976:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.165984:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166006:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778955.166011:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166020:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166033:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778955.166036:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778955.166041:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166048:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166092:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607549e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce6c expref: 32 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166103:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:0.0:1790778955.166105:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778955.166108:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc8763265607549e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce6c expref: 32 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.166115:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0e00, rc 0) 00000100:00100000:0.0:1790778955.166182:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:11414:x1877767510634880:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 516us (811us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1790778955.166189:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:1.0:1790778955.170586:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.171417:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510635008 00000100:00100000:3.0:1790778955.171429:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510635008 00000100:00100000:3.0:1790778955.171535:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 177 00000100:00100000:3.0:1790778955.171546:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+31:11414:x1877767510635008:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790778955.171614:0:12797:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790778955.171750:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+31:11414:x1877767510635008:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 204us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.171758:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 177 00000100:00100000:3.0:1790778955.175797:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.175895:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510635264 00000100:00100000:0.0:1790778955.175925:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510635264 00000100:00100000:0.0:1790778955.176002:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 178 00000100:00100000:0.0:1790778955.176015:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+31:11414:x1877767510635264:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.176046:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778955.176050:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790778955.176086:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607545f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce5e expref: 31 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.176108:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778955.176114:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778955.176130:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560754b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce73 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790778955.176659:0:7119:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790778955.176812:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560754ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.176828:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560754ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.176839:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560754ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.176902:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc876326560754b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce73 expref: 33 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.176919:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560754ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce73 expref: 32 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.176940:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778955.176943:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778955.176946:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1600, rc 0) 00000100:00100000:0.0:1790778955.177023:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+32:11414:x1877767510635264:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1009us (1235us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1790778955.177031:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 178 00000100:00100000:1.0:1790778955.193348:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.193602:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510635520 00000100:00100000:0.0:1790778955.193612:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510635520 00000100:00100000:0.0:1790778955.193675:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 179 00000100:00100000:0.0:1790778955.193686:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+32:11414:x1877767510635520:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.193776:0:5949:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778955.193805:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560754ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce73 expref: 32 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.193824:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef235cc0900) 00010000:00010000:0.0:1790778955.193835:0:5949:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778955.193862:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.193880:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.193890:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.193954:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.193983:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.193990:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194421:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194430:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194438:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194474:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778955.194480:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194489:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194498:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778955.194501:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778955.194514:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194521:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194534:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194549:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194555:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194560:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778955.194563:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194570:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194579:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6392ab99 (ffff9ef235cc0f00) 00010000:00010000:0.0:1790778955.194582:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778955.194585:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.194592:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6392ab99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.194768:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:11414:x1877767510635520:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1081us (1426us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790778955.194777:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 179 00000100:00100000:1.0:1790778955.201371:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.201469:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510635648 00000100:00100000:3.0:1790778955.201478:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510635648 00000100:00100000:3.0:1790778955.201544:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 180 00000100:00100000:3.0:1790778955.201554:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+31:11414:x1877767510635648:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778955.201579:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778955.201601:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560754d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce7a expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.201639:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.201654:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.201665:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.201780:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aba00/0xdc876326560754d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 33 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.201811:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 32 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.201820:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778955.201823:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778955.201826:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778955.201888:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+32:11414:x1877767510635648:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 335us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.201895:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 180 00000100:00100000:3.0:1790778955.211559:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.211812:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510635904 00000100:00100000:0.0:1790778955.211824:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510635904 00000100:00100000:0.0:1790778955.211900:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 181 00000100:00100000:0.0:1790778955.211912:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+32:11414:x1877767510635904:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.212043:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.212081:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.212093:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790778955.212329:0:7119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1790778955.212340:0:7119:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349087896552ns, next at 350087893797ns, rc = 0 00000004:00010000:0.0:1790778955.212400:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002eee2206 reply state 00000000c4c53445 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.212411:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778955.212573:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+34:11414:x1877767510635904:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 661us (1028us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1790778955.212581:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 181 00010000:00010000:2.0:1790778955.214990:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.215033:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.215042:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.215049:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778955.215054:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.215063:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.215081:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:2.0:1790778955.215084:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790778955.215090:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.215097:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560754e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.217483:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.217570:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510636032 00000100:00100000:0.0:1790778955.217581:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510636032 00000100:00100000:0.0:1790778955.217715:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 182 00000100:00100000:0.0:1790778955.217729:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+33:11414:x1877767510636032:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.217764:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778955.217788:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce81 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.217871:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 34 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.217889:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 34 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.217933:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:0.0:1790778955.217937:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790778955.217940:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0e00, rc 0) 00000100:00100000:0.0:1790778955.218029:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+34:11414:x1877767510636032:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 302us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.218037:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 182 00000100:00100000:0.0:1790778955.224628:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.226003:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510636160 00000100:00100000:1.0:1790778955.226020:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510636160 00000100:00080000:3.0:1790778955.226135:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778955.226138:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1790778955.226151:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+6:2345:x1877767510636160:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790778955.226429:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510636160:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 280us (1809us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790778955.226437:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1790778955.231161:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.231245:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510636416 00000100:00100000:1.0:1790778955.231259:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510636416 00000100:00100000:1.0:1790778955.231328:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:1.0:1790778955.231340:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+34:11414:x1877767510636416:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790778955.231640:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:11414:x1877767510636416:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 303us (489us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790778955.231649:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1790778955.235194:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778955.235231:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510636672 00000100:00100000:2.0:1790778955.235241:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510636672 00000100:00100000:2.0:1790778955.235290:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:2.0:1790778955.235299:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+35:11414:x1877767510636672:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790778955.235404:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+35:11414:x1877767510636672:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.235428:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:2.0:1790778955.239288:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778955.239326:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510636800 00000100:00100000:2.0:1790778955.239337:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510636800 00000100:00100000:2.0:1790778955.239391:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:2.0:1790778955.239400:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+35:11414:x1877767510636800:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778955.239427:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778955.239464:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560754f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce88 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.239547:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560754f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.239561:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560754f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.239573:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560754f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778955.239619:0:12797:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778955.239636:0:12797:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560754f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.239661:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc876326560754f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce88 expref: 37 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.239676:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560754f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce88 expref: 36 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.239700:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:2.0:1790778955.239703:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790778955.239707:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5e00, rc 0) 00000100:00100000:2.0:1790778955.239753:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+36:11414:x1877767510636800:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 354us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.239760:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:2.0:1790778955.248392:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.248586:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510636928 00000100:00100000:3.0:1790778955.248598:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510636928 00000100:00100000:3.0:1790778955.248688:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1790778955.248701:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510636928:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778955.248724:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778955.248749:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce8f expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778955.248781:0:6934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1e4b, blocks: 0x0 00010000:00010000:3.0:1790778955.248802:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1790778955.248807:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778955.248817:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 8 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.248854:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 8 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.248870:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aba00, rc 0) 00000100:00100000:3.0:1790778955.248959:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510636928:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 261us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.248967:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:0.0:1790778955.253077:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778955.253179:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510637184 00000100:00100000:2.0:1790778955.253191:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510637184 00000100:00100000:2.0:1790778955.253297:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 185 00000100:00100000:2.0:1790778955.253308:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:11414:x1877767510637184:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790778955.253430:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:11414:x1877767510637184:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 124us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.253437:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 185 00000100:00100000:0.0:1790778955.257298:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.257385:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510637312 00000100:00100000:1.0:1790778955.257395:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510637312 00000100:00100000:1.0:1790778955.257485:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1790778955.257496:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:11414:x1877767510637312:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790778955.257524:0:12307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.257542:0:12307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce96 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.257577:0:12307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.257587:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778955.257591:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778955.257597:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 9 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.257627:0:12307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.257640:0:12307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.257655:0:12307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12307:1877767531605376:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778955.257751:0:12307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006840 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.262159:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.262326:0:12307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12307:1877767531605376:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778955.262370:0:12307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 9 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.262391:0:12307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387600, rc 0) 00000100:00100000:1.0:1790778955.262475:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+9:11414:x1877767510637312:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4980us (5187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.262485:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:0.0:1790778955.262665:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510637440 00000100:00100000:0.0:1790778955.262673:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510637440 00010000:00010000:0.0:1790778955.262707:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.262748:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:0.0:1790778955.262758:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510637440:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778955.262775:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778955.262801:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.262814:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.262837:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075500 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce8f expref: 9 pid: 6934 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.262870:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778955.262875:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778955.262884:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.262900:0:12059:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.262934:0:12059:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.262949:0:12059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:12059:1877767531605504:192.168.202.2@tcp:105: 00000100:00100000:0.0:1790778955.263024:0:12059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.280863:0:12059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:12059:1877767531605504:192.168.202.2@tcp:105: 00010000:00010000:1.0:1790778955.280890:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778955.280966:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510637440:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 18208us (18816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.280979:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:2.0:1790778955.291387:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.291585:0:6940:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510637568 00000100:00100000:1.0:1790778955.291596:0:6940:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510637568 00002000:00100000:1.0:1790778955.291649:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ef2333dd880 x1877767510637568/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:506/0 lens 504/0 e 0 to 0 dl 1790778966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778955.291660:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2333dd880 with x1877767510637568 ext(0->8) 00002000:00010000:1.0:1790778955.291667:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2333dd880 00000100:00100000:1.0:1790778955.291705:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1790778955.291716:0:6940:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510637568:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790778955.294001:0:6940:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+10:2346:x1877767510637568:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 2275us (2614us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790778955.294024:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00002000:00100000:1.0:1790778955.294040:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ef2333dd880 x1877767510637568/t4294967314(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:506/0 lens 504/448 e 0 to 0 dl 1790778966 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778955.294049:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2333dd880 with x1877767510637568 ext(0->8) 00002000:00010000:1.0:1790778955.294056:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2333dd880 00000100:00100000:1.0:1790778955.306663:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.306839:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510637696 00000100:00100000:3.0:1790778955.306850:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510637696 00000100:00100000:3.0:1790778955.306979:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 186 00000100:00100000:3.0:1790778955.306990:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+36:11414:x1877767510637696:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790778955.312661:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1790778955.312678:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1790778955.312721:0:5927:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1790778955.312747:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1790778955.312760:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1790778955.312926:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:11414:x1877767510637696:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 5931us (6264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.312937:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 186 00000100:00100000:0.0:1790778955.312985:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531605632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790778955.313189:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778955.313789:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531605632 00000100:00100000:2.0:1790778955.313802:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531605632 00000100:00100000:2.0:1790778955.313983:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790778955.313996:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531605632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790778955.314185:0:6935:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790778955.314190:0:6935:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790778955 00002000:00010000:2.0:1790778955.314194:0:6935:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790778955.314197:0:6935:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790778955 -> 1790778955 00002000:00010000:2.0:1790778955.314200:0:6935:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790778955.314496:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531605632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 504us (1415us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790778955.314516:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1790778955.314654:0:3439:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef2369b9500/2, rc 0, transno 4294967315 00000100:00100000:2.0:1790778955.314662:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531605632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790778955.319608:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.321653:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510637824 00000100:00100000:0.0:1790778955.321672:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510637824 00000100:00100000:0.0:1790778955.321771:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:0.0:1790778955.321787:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+10:2345:x1877767510637824:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790778955.328127:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1790778955.328145:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1790778955.328300:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510637824:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 6512us (8697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.328312:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1790778955.331834:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.331986:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510638080 00000100:00100000:0.0:1790778955.331996:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510638080 00000100:00100000:0.0:1790778955.332164:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 187 00000100:00100000:0.0:1790778955.332175:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+19:11414:x1877767510638080:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.332238:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778955.332267:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560754f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce88 expref: 19 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.332286:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:0.0:1790778955.332290:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778955.332320:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.332333:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.332342:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790778955.332500:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000028c29e88 reply state 00000000801a253a transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.332522:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790778955.332614:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+20:11414:x1877767510638080:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 441us (790us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1790778955.332621:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 187 00010000:00010000:3.0:1790778955.338366:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.338388:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.338395:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.338402:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778955.338406:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.338427:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.338486:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778955.338490:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778955.338495:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.338835:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.339344:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510638208 00000100:00100000:0.0:1790778955.339355:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510638208 00000100:00100000:0.0:1790778955.339477:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:0.0:1790778955.339488:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510638208:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790778955.339677:0:6934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790778955.339689:0:6934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790778955 -> 1790778954 00002000:00010000:0.0:1790778955.339692:0:6934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790778953 00002000:00010000:0.0:1790778955.339814:0:6934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790778955 -> 1790778954 00002000:00010000:0.0:1790778955.339818:0:6934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790778955.339878:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510638208:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 391us (1046us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790778955.339887:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00010000:00010000:3.0:1790778955.341628:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc8763265607550e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.345861:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.346214:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510638464 00000100:00100000:1.0:1790778955.346224:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510638464 00000100:00100000:1.0:1790778955.346282:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00100000:1.0:1790778955.346292:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:11414:x1877767510638464:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790778955.346367:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.346386:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 19 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.346396:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.346432:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 19 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.346470:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 19 pid: 12797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.346514:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531605760:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778955.346612:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2040066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.354882:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.354916:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510638592 00000100:00100000:3.0:1790778955.354927:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510638592 00000100:00100000:1.0:1790778955.354948:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531605760:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778955.354964:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 20 pid: 12797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.354970:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.355004:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:3.0:1790778955.355013:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+20:2345:x1877767510638592:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778955.355029:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778955.355036:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 20 pid: 12797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.355048:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 20 pid: 12797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.355071:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa400/0xdc876326560754dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce7a expref: 20 pid: 12797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.355101:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778955.355106:0:5933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.355115:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.355122:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.355153:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778955.355204:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:2345:x1877767510638592:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 191us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.355211:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00010000:00010000:1.0:1790778955.355498:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355518:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355558:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355566:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355572:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355579:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.355583:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355591:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355610:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:1.0:1790778955.355612:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790778955.355616:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.355622:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075515 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.355667:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+18:11414:x1877767510638464:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 9376us (9817us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790778955.355675:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00100000:0.0:1790778955.361575:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.361614:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510638720 00000100:00100000:0.0:1790778955.361624:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510638720 00000100:00100000:0.0:1790778955.361700:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1790778955.361712:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510638720:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790778955.361765:0:12307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.361787:0:12307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.361796:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778955.361800:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778955.361805:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.361843:0:12307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 8 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.361875:0:12307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 8 pid: 12307 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.361907:0:12307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12307:1877767531605888:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778955.362009:0:12307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1790778955.366722:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.366778:0:12307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12307:1877767531605888:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778955.366806:0:12307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.367214:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510638848 00000100:00100000:2.0:1790778955.367223:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510638848 00010000:00010000:2.0:1790778955.367258:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 9 pid: 12307 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.367299:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:2.0:1790778955.367308:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510638848:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778955.367322:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778955.367346:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 9 pid: 12307 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367358:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 9 pid: 12307 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367396:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007431da8d/0xdc87632656075507 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce96 expref: 9 pid: 12307 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367410:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790778955.367415:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790778955.367421:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367431:0:5934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367484:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778955.367550:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510638848:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 241us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.367558:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00010000:00010000:2.0:1790778955.367583:0:12307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367592:0:12307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367611:0:12307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367620:0:12307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367636:0:12307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367643:0:12307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790778955.367649:0:12307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367659:0:12307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367671:0:12307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.367679:0:12307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc8763265607551c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.367728:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510638720:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 6018us (6161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778955.367736:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:3.0:1790778955.372390:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778955.372527:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510639104 00000100:00100000:2.0:1790778955.372536:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510639104 00000100:00100000:2.0:1790778955.372585:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 189 00000100:00100000:2.0:1790778955.372595:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:11414:x1877767510639104:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790778955.372681:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.372710:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.372720:0:5950:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.372755:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.372770:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 18 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.372786:0:5950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531606016:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778955.372860:0:5950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.375939:0:5950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531606016:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778955.375980:0:5950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.377806:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.380477:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510639232 00000100:00100000:0.0:1790778955.380493:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510639232 00010000:00010000:0.0:1790778955.380563:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 19 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.380615:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:0.0:1790778955.380626:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:2346:x1877767510639232:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778955.380646:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778955.380654:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 19 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.380670:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 19 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.380698:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607536a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce1f expref: 19 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.380720:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:0.0:1790778955.380728:0:5933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.380758:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.380767:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778955.384942:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778955.385034:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+18:2346:x1877767510639232:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4401us (7228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778955.385049:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00010000:00010000:2.0:1790778955.385398:0:5950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.385412:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.385671:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.385691:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.385712:0:5950:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.385749:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.385761:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 18 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.385774:0:5950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531606144:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778955.385851:0:5950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc540 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.393471:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.393556:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510639360 00000100:00100000:3.0:1790778955.393566:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510639360 00000100:00100000:1.0:1790778955.393605:0:5950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531606144:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778955.393622:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 19 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.393641:0:5950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.393977:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:3.0:1790778955.394000:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:2346:x1877767510639360:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778955.394022:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778955.394032:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 19 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.394056:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 19 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.394085:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560754eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce81 expref: 19 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.394103:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778955.394118:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.394130:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.394138:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.394172:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778955.394203:0:5950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.394214:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.394251:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:2346:x1877767510639360:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 254us (818us total) trans 0 rc 0/0 00000001:00080000:1.0:1790778955.394355:0:5950:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1790778955.394516:0:5950:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1790778955.394552:0:5950:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1790778955.394629:0:5950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5950:1877767531606272:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790778955.394678:0:5950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.394705:0:5950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006540 going to sleep for 11 seconds 00000100:00100000:1.0:1790778955.394724:0:5954:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531606272 00000100:00100000:1.0:1790778955.394729:0:5954:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531606272 00000100:00100000:1.0:1790778955.394778:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778955.394786:0:5954:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5950:x1877767531606272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790778955.394872:0:5954:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5950:x1877767531606272:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.394879:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790778955.394911:0:5950:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1790778955.394917:0:5950:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef2369b9500, transno 4294967315 00000100:00100000:3.0:1790778955.394937:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:1.0:1790778955.394941:0:5950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5950:1877767531606272:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790778955.395070:0:5950:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1790778955.395108:0:5950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5950:1877767531606400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790778955.395134:0:5950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778955.395157:0:5950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006840 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.395201:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531606400 00000100:00100000:2.0:1790778955.395207:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531606400 00000100:00100000:2.0:1790778955.395237:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790778955.395245:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5950:x1877767531606400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790778955.395335:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5950:x1877767531606400:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (201us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790778955.395342:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790778955.395368:0:5950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5950:1877767531606400:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790778955.395399:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395420:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395428:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395435:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778955.395473:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395484:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395497:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778955.395500:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790778955.395518:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395525:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc8763265607552a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395558:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395567:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395573:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395579:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778955.395588:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395595:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395863:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778955.395868:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790778955.395872:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.395879:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075466 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.396021:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.396036:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.396044:0:5950:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.396076:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778955.396089:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 21 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778955.396100:0:5950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531606528:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778955.396174:0:5950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1790778955.400602:0:5950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5950:1877767531606528:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778955.400633:0:5950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778955.401802:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.401862:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510639488 00000100:00100000:3.0:1790778955.401871:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510639488 00010000:00010000:3.0:1790778955.401913:0:5933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 22 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.401960:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:3.0:1790778955.401970:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+22:2345:x1877767510639488:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778955.401989:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778955.401996:0:5933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 22 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.402008:0:5933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 22 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.402033:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce65 expref: 22 pid: 5949 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.402061:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:3.0:1790778955.402067:0:5933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.402080:0:5933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.402088:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.402130:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778955.402191:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:2345:x1877767510639488:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 221us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.402199:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00010000:00010000:1.0:1790778955.402378:0:5950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402389:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402402:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402409:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402417:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402423:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.402427:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402473:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402484:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778955.402487:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778955.402491:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402498:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075531 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402518:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402523:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402529:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402534:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.402537:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402542:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402550:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef2363a9100) 00010000:00010000:1.0:1790778955.402552:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790778955.402555:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.402569:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc87632656075523 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.402726:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:11414:x1877767510639104:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 30131us (30345us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1790778955.402736:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 189 00000020:00080000:1.0:1790778955.402740:0:5950:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790778955.402949:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778955.402954:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778955.403770:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1790778955.403789:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778955.411714:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.411909:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510639744 00000100:00100000:1.0:1790778955.411924:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510639744 00000100:00100000:1.0:1790778955.411999:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:1.0:1790778955.412010:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+20:11414:x1877767510639744:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790778955.412882:0:5952:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790778955.413278:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790778955.413315:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.413332:0:5952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.413344:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.413353:0:5952:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.413360:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.413366:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.413394:0:5952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790778955.413426:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778955.413436:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.413544:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778955.413548:0:6950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.413558:0:6950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.413571:0:6950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef215c54b00) 00010000:00010000:3.0:1790778955.413575:0:6950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790778955.413579:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.413596:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.413613:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778955.413615:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778955.413617:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778955.413804:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+22:11414:x1877767510639744:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1793us (2111us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790778955.413816:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000020:00080000:1.0:1790778955.413824:0:5952:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790778955.535256:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790778955.646235:0:12836:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778955.646248:0:12836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778955.646277:0:12836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790778955.646286:0:12836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778955.826281:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.826357:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510640000 00000100:00100000:1.0:1790778955.826368:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510640000 00000100:00100000:1.0:1790778955.826431:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:1.0:1790778955.826623:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+22:11424:x1877767510640000:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778955.826655:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.826678:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607553f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dce9d expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.826807:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075546 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.826822:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.826834:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778955.826846:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790778955.827011:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc8763265607553f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce9d expref: 25 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.827030:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce9d expref: 24 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.827053:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778955.827056:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778955.827060:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387800, rc 0) 00000100:00100000:1.0:1790778955.827128:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+24:11424:x1877767510640000:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 687us (860us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1790778955.827137:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:0.0:1790778955.829564:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.829807:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510640128 00000100:00100000:1.0:1790778955.829817:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510640128 00000100:00100000:1.0:1790778955.829880:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:1.0:1790778955.829890:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+24:11424:x1877767510640128:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1790778955.829964:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.829981:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.829993:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830009:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830017:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830024:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830099:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830126:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830135:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778955.830181:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830194:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830202:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830210:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830217:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.830222:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830230:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830243:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778955.830246:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778955.830251:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830258:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830277:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830283:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830289:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830295:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.830298:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830305:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830313:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef215c54300) 00010000:00010000:1.0:1790778955.830316:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778955.830319:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830326:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387600/0xdc8763265607555b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830340:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830347:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830354:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830364:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.830368:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830375:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830383:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54200) 00010000:00010000:1.0:1790778955.830386:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778955.830389:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.830395:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.830587:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+24:11424:x1877767510640128:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 697us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.830596:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:0.0:1790778955.875218:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.875322:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510640384 00000100:00100000:1.0:1790778955.875334:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510640384 00000100:00100000:1.0:1790778955.875507:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:1.0:1790778955.875521:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+24:11427:x1877767510640384:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790778955.875547:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.875571:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcea4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875658:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875692:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875705:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875723:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875732:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875739:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875863:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875873:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875881:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778955.875891:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790778955.875972:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875981:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.875988:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876001:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.876005:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876013:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876026:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778955.876029:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778955.876034:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876040:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876055:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876062:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876068:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876073:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.876076:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876082:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876101:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef215c54200) 00010000:00010000:1.0:1790778955.876104:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778955.876107:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876113:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc87632656075577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876154:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 27 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876182:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 26 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.876190:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778955.876193:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778955.876195:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165ae00, rc 0) 00000100:00100000:1.0:1790778955.876267:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+26:11427:x1877767510640384:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 749us (1120us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790778955.876275:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:0.0:1790778955.892028:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.892148:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510640512 00000100:00100000:1.0:1790778955.892173:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510640512 00000100:00100000:1.0:1790778955.892250:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:1.0:1790778955.892261:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:11427:x1877767510640512:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1790778955.892347:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892367:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892398:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892694:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892702:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892709:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892715:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778955.892720:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892727:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892740:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778955.892743:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790778955.892747:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.892753:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc8763265607558c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.892830:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:11427:x1877767510640512:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 571us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778955.892838:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:3.0:1790778955.901309:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778955.901477:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510640768 00000100:00100000:0.0:1790778955.901506:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510640768 00000100:00100000:0.0:1790778955.901561:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1790778955.901571:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+26:11427:x1877767510640768:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778955.902062:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:11427:x1877767510640768:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 490us (760us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1790778955.902070:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1790778955.972419:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778955.972918:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641024 00000100:00100000:1.0:1790778955.972946:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641024 00000100:00100000:1.0:1790778955.973013:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:1.0:1790778955.973025:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+27:10961:x1877767510641024:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778955.973055:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778955.973076:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075593 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dceab expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.973199:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.973214:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 28 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.973224:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.973261:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 28 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.973276:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 28 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.973289:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531606656:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778955.973558:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006240 going to sleep for 11 seconds 00000100:00100000:0.0:1790778955.986918:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778955.987331:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641152 00000100:00100000:3.0:1790778955.987342:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641152 00010000:00010000:3.0:1790778955.987407:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 29 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778955.987517:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:3.0:1790778955.987529:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+29:2346:x1877767510641152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778955.987549:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778955.987557:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 29 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.987572:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 29 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.987599:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:3.0:1790778955.987606:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.987618:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.987647:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778955.987669:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778955.987738:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+29:2346:x1877767510641152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 211us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778955.987745:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00010000:00010000:1.0:1790778955.989929:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607557e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcea4 expref: 28 pid: 5950 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778955.989956:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531606656:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778955.989998:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.990008:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.990014:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778955.990035:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790778955.990219:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc87632656075593 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 29 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.990235:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 28 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778955.990244:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778955.990247:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778955.990250:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165b200, rc 0) 00000100:00100000:1.0:1790778955.990318:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:10961:x1877767510641024:12345-192.168.202.2@tcp:101:bash.0 Request processed in 17295us (17909us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1790778955.990327:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:0.0:1790778956.006747:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.007219:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641280 00000100:00100000:1.0:1790778956.007230:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641280 00000100:00100000:1.0:1790778956.007296:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 195 00000100:00100000:1.0:1790778956.007307:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+28:10961:x1877767510641280:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778956.007334:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778956.007354:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc876326560755a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dceb2 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.007398:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560755af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.007415:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560755af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.007427:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560755af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.007594:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc876326560755a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceb2 expref: 30 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.007614:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560755af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceb2 expref: 29 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.007626:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.007629:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790778956.007633:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165ae00, rc 0) 00000100:00100000:1.0:1790778956.007702:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+29:10961:x1877767510641280:12345-192.168.202.2@tcp:101:bash.0 Request processed in 396us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.007710:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 195 00000100:00100000:2.0:1790778956.017576:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.017806:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641536 00000100:00100000:1.0:1790778956.017819:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641536 00000100:00100000:1.0:1790778956.017942:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:1.0:1790778956.017955:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+29:10961:x1877767510641536:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1790778956.018224:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.018260:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.018273:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790778956.018320:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1790778956.018344:0:7119:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086522f8e reply state 000000009bb18cf5 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.018354:0:7119:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790778956.018406:0:7119:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1790778956.018567:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+33:10961:x1877767510641536:12345-192.168.202.2@tcp:36:bash.0 Request processed in 613us (1002us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1790778956.018575:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 196 00000020:00080000:1.0:1790778956.018581:0:7119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790778956.020905:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.020923:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.020931:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.020936:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778956.020941:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.020948:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.020964:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:0.0:1790778956.020967:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778956.020972:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.020978:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc876326560755b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.021942:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.022301:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641664 00000100:00100000:1.0:1790778956.022312:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641664 00000100:00100000:1.0:1790778956.022607:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 197 00000100:00100000:1.0:1790778956.022617:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+32:10961:x1877767510641664:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778956.022645:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778956.022666:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc876326560755bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dceb9 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.022749:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc876326560755bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceb9 expref: 33 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.022762:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc876326560755bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceb9 expref: 33 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.022816:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.022819:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790778956.022823:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165a000, rc 0) 00000100:00100000:1.0:1790778956.022946:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+33:10961:x1877767510641664:12345-192.168.202.2@tcp:101:bash.0 Request processed in 330us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.022954:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 197 00000100:00100000:2.0:1790778956.026319:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.026625:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641792 00000100:00100000:1.0:1790778956.026639:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641792 00000100:00100000:1.0:1790778956.026798:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:1.0:1790778956.026812:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:10961:x1877767510641792:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778956.026835:0:6935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778956.026866:0:6935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcec0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778956.027128:0:6935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd1e4a, atime: 0x6abd1e49, ctime: 0x6abd1e4a, blocks: 0x8 00010000:00010000:1.0:1790778956.027159:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1790778956.027165:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778956.027176:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 8 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.027196:0:6935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 8 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.027211:0:6935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165be00, rc 0) 00000100:00100000:1.0:1790778956.027289:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:10961:x1877767510641792:12345-192.168.202.2@tcp:101:bash.0 Request processed in 479us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.027314:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:3.0:1790778956.032644:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.032847:0:6942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510641920 00000100:00100000:0.0:1790778956.032860:0:6942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510641920 00002000:00010000:0.0:1790778956.032915:0:6942:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1790778956.032921:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236614a80 with x1877767510641920 ext(0->18446744073709551615) 00002000:00010000:0.0:1790778956.032946:0:6942:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236614a80. 00000100:00100000:0.0:1790778956.032989:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1790778956.033001:0:6942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510641920:12345-192.168.202.2@tcp:10:bash.0 00002000:00010000:0.0:1790778956.033531:0:6942:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790778956.033535:0:6942:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790778954 -> 1790778956 00002000:00010000:0.0:1790778956.033537:0:6942:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790778953 -> 1790778953 00002000:00010000:0.0:1790778956.033540:0:6942:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790778954 -> 1790778956 00002000:00010000:0.0:1790778956.033542:0:6942:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1790778956.033611:0:6942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510641920:12345-192.168.202.2@tcp:10:bash.0 Request processed in 611us (982us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790778956.033621:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00002000:00010000:0.0:1790778956.033626:0:6942:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1790778956.033629:0:6942:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236614a80 with x1877767510641920 ext(0->18446744073709551615) 00002000:00010000:0.0:1790778956.033633:0:6942:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236614a80. 00000100:00100000:2.0:1790778956.117798:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.118200:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510642048 00000100:00100000:1.0:1790778956.118210:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510642048 00000100:00100000:1.0:1790778956.118327:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:1.0:1790778956.118338:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:11441:x1877767510642048:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1790778956.118437:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.118487:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.118509:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.118527:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.118535:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.118541:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119064:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119076:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119083:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778956.119166:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119179:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119186:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119195:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119202:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165aa00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.119206:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119215:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119228:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778956.119232:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.119236:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119243:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc876326560755cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119259:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119266:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119279:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119286:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.119289:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119296:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119304:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef215c54000) 00010000:00010000:1.0:1790778956.119307:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.119310:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119316:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560755d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119335:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119341:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119347:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.119353:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.120182:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.120211:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.120224:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.120227:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.120231:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.120239:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560755d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.120347:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+33:11441:x1877767510642048:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 2007us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.120358:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:3.0:1790778956.204589:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.211074:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510642304 00000100:00100000:1.0:1790778956.211095:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510642304 00000100:00100000:2.0:1790778956.211317:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 199 00000100:00100000:2.0:1790778956.211332:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+33:11444:x1877767510642304:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778956.211384:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778956.211410:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560755e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcec7 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.211529:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.211547:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.211562:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.211579:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.211588:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.211596:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215113:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560755f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215136:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560755f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215148:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560755f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778956.215163:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790778956.215274:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215283:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215291:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215298:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778956.215303:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215311:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215325:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:2.0:1790778956.215328:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778956.215334:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215341:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc876326560755e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215356:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215363:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215369:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215373:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778956.215383:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215390:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215398:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef2363a9800) 00010000:00010000:2.0:1790778956.215401:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778956.215403:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215409:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4400/0xdc876326560755ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215521:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560755e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec7 expref: 36 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215536:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560755f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec7 expref: 35 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.215544:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:2.0:1790778956.215546:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790778956.215549:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5400, rc 0) 00000100:00100000:2.0:1790778956.215614:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+35:11444:x1877767510642304:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 4285us (11039us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790778956.215623:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 199 00000100:00100000:2.0:1790778956.228631:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.228747:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510642432 00000100:00100000:1.0:1790778956.228760:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510642432 00000100:00100000:1.0:1790778956.228825:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:1.0:1790778956.228836:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:11444:x1877767510642432:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1790778956.228932:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.228953:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 35 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.228964:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.229019:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 35 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.229034:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 35 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.229050:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531606784:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778956.229179:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778956.236572:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.237170:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510642688 00000100:00100000:2.0:1790778956.237183:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510642688 00000100:00100000:2.0:1790778956.237251:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1790778956.237280:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+36:5435:x1877767510642688:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790778956.237666:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+37:5435:x1877767510642688:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 390us (1102us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790778956.237675:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:1.0:1790778956.239803:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531606784:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778956.239838:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.242316:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778956.243033:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510642816 00000100:00100000:3.0:1790778956.243048:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510642816 00010000:00010000:3.0:1790778956.243116:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 37 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778956.243169:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1790778956.243179:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+37:2346:x1877767510642816:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778956.243196:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778956.243203:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 37 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.243217:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 37 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.243242:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607559a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceab expref: 37 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.243262:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:3.0:1790778956.243281:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.243293:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.243302:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.243340:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778956.244263:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+36:2346:x1877767510642816:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1075us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.244276:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00010000:00010000:1.0:1790778956.244930:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.244946:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.244998:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.245006:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.245014:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.245020:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.245025:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.245046:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.245063:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.245067:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790778956.245072:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.245079:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc87632656075603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.245168:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:11444:x1877767510642432:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 16331us (16545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.245178:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:2.0:1790778956.248831:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778956.248886:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510643072 00000100:00100000:3.0:1790778956.248953:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510643072 00000100:00100000:3.0:1790778956.249010:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1790778956.249020:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+35:11444:x1877767510643072:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790778956.249675:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:11444:x1877767510643072:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 653us (848us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790778956.249684:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1790778956.373016:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.373217:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510643328 00000100:00100000:1.0:1790778956.373230:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510643328 00000100:00100000:1.0:1790778956.373303:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 201 00000100:00100000:1.0:1790778956.373315:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+36:11455:x1877767510643328:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1790778956.373348:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778956.373372:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607560a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcece expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.373519:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.373536:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.373550:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.373586:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.373594:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.373600:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375022:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607561f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375040:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607561f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375050:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607561f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778956.375062:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1790778956.375255:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375264:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375271:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375278:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.375282:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375307:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375320:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778956.375323:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.375327:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375333:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375350:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375356:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375362:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375368:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165aa00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.375371:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375376:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375382:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef215c54000) 00010000:00010000:1.0:1790778956.375385:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.375387:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375403:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375520:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607560a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcece expref: 39 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375537:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607561f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcece expref: 38 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.375545:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.375548:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778956.375550:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165b200, rc 0) 00000100:00100000:1.0:1790778956.380909:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+38:11455:x1877767510643328:12345-192.168.202.2@tcp:101:cat.0 Request processed in 7583us (7900us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790778956.380922:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 201 00000100:00100000:0.0:1790778956.388621:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.388750:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510643584 00000100:00100000:2.0:1790778956.388760:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510643584 00000100:00100000:2.0:1790778956.388818:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:2.0:1790778956.388830:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+38:11455:x1877767510643584:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:2.0:1790778956.389123:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+39:11455:x1877767510643584:12345-192.168.202.2@tcp:35:cat.0 Request processed in 295us (522us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790778956.389131:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:3.0:1790778956.437636:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.438000:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510643840 00000100:00100000:1.0:1790778956.438012:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510643840 00000100:00100000:1.0:1790778956.438182:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:1.0:1790778956.438193:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+39:11456:x1877767510643840:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:1.0:1790778956.438252:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1790778956.438277:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a000/0xdc876326560755bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceb9 expref: 39 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438300:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc8763265607561f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcece expref: 38 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438333:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc876326560755f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec7 expref: 37 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438344:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560755af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceb2 expref: 36 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438354:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.438424:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778956.438504:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438518:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438527:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438542:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438549:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438556:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438687:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438697:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.438711:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790778956.441761:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1790778956.441785:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350317341560ns, next at 351317333706ns, rc = 0 00010000:00010000:1.0:1790778956.441865:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.441881:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.441890:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.441899:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.441905:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.441911:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.441932:0:5951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790778956.442347:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442367:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442374:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442393:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.442398:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442405:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442418:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54e00) 00010000:00010000:1.0:1790778956.442421:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790778956.442425:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442431:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc8763265607563b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442474:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442481:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442487:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442501:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.442505:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442510:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442527:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778956.442530:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.442533:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.442539:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607562d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778956.442549:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003b417e06 reply state 000000006b8fa6ed transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.442558:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790778956.443223:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+37:11456:x1877767510643840:12345-192.168.202.2@tcp:36:rm.0 Request processed in 5026us (5591us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1790778956.443234:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 202 00010000:00010000:3.0:1790778956.443319:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778956.443326:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.443334:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778956.443337:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.443357:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.443367:0:5936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef215c54e00) 00010000:00010000:3.0:1790778956.443370:0:5936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790778956.443374:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.443381:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc87632656075642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.443398:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778956.443400:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778956.443401:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778956.446959:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.446980:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.446990:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.446997:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165aa00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778956.447002:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.447010:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.447029:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef215c54000) 00010000:00010000:3.0:1790778956.447048:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778956.447055:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.447062:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075634 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778956.512596:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.513010:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644096 00000100:00100000:1.0:1790778956.513022:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644096 00000100:00100000:2.0:1790778956.513312:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 203 00000100:00100000:2.0:1790778956.513324:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+36:11462:x1877767510644096:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778956.513370:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778956.513400:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dced5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.513567:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.513584:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.513597:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.513745:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.513754:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.513761:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790778956.514292:0:5949:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1790778956.514585:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514599:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514685:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514733:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514741:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514748:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514755:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778956.514760:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514785:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514800:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:2.0:1790778956.514803:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778956.514809:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.514815:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790778956.514830:0:5949:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e12c0999 reply state 000000001eebdcf9 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.514840:0:5949:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790778956.514873:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc87632656075649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 39 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.515766:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 38 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.515779:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:2.0:1790778956.515781:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778956.515785:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4c00, rc 0) 00000100:00100000:2.0:1790778956.515874:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+39:11462:x1877767510644096:12345-192.168.202.2@tcp:101:bash.0 Request processed in 2551us (3288us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790778956.515892:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 203 00010000:00010000:2.0:1790778956.519067:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.519175:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.519186:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.519192:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778956.519198:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.519208:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.519230:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef2363a9800) 00010000:00010000:2.0:1790778956.519234:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778956.519240:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.519247:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075657 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778956.520437:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.520561:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644224 00000100:00100000:0.0:1790778956.520573:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644224 00000100:00100000:0.0:1790778956.520654:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1790778956.520669:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2344:x1877767510644224:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778956.520691:0:6937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778956.520712:0:6937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcedc expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790778956.520738:0:6937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790778956.520759:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1790778956.520764:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778956.520774:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 8 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.520810:0:6937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 8 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.520820:0:6937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1400, rc 0) 00000100:00080000:3.0:1790778956.520965:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790778956.521116:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2344:x1877767510644224:12345-192.168.202.2@tcp:101:bash.0 Request processed in 451us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.521124:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1790778956.524156:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778956.524241:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644352 00000100:00100000:3.0:1790778956.524251:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644352 00000100:00100000:3.0:1790778956.524301:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:3.0:1790778956.524309:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:11462:x1877767510644352:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790778956.524325:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778956.524340:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcee3 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.524377:0:6934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 9 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.524385:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778956.524389:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778956.524395:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 9 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.524428:0:6934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 9 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.524475:0:6934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 9 pid: 6937 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778956.524486:0:6934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6934:1877767531606912:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778956.524599:0:6934:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778956.526968:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.527108:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644480 00000100:00100000:2.0:1790778956.527117:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644480 00010000:00010000:2.0:1790778956.527156:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 10 pid: 6937 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.527228:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1790778956.527236:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+10:2345:x1877767510644480:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778956.527248:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778956.527275:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 10 pid: 6937 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.527285:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 10 pid: 6937 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.527305:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778956.527308:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778956.527314:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 10 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.527322:0:5934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 10 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.527348:0:5934:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 10 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.527371:0:5934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205bb1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5934:1877767531607040:192.168.202.2@tcp:105: 00000100:00100000:2.0:1790778956.527474:0:5934:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc840 going to sleep for 11 seconds 00010000:00010000:3.0:1790778956.527555:0:6934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001846025c/0xdc8763265607566c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcedc expref: 10 pid: 6937 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778956.527570:0:6934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6934:1877767531606912:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778956.527592:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 9 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.527602:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790778956.527643:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:11462:x1877767510644352:12345-192.168.202.2@tcp:101:bash.0 Request processed in 3334us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.527650:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1790778956.531310:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.531544:0:5934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205bb1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5934:1877767531607040:192.168.202.2@tcp:105: 00010000:00010000:2.0:1790778956.531569:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778956.531640:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510644480:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4403us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778956.531651:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1790778956.531741:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644736 00000100:00100000:0.0:1790778956.531747:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644736 00000100:00100000:0.0:1790778956.531786:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:0.0:1790778956.531796:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+38:11462:x1877767510644736:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:0.0:1790778956.532039:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+39:11462:x1877767510644736:12345-192.168.202.2@tcp:35:bash.0 Request processed in 246us (744us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1790778956.532044:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00010000:00010000:3.0:1790778956.556054:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778956.620743:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.620802:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.620900:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778956.621041:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644992 00000100:00100000:3.0:1790778956.621054:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644992 00000100:00100000:1.0:1790778956.621085:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510645120 00000100:00100000:1.0:1790778956.621089:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510645120 00000100:00100000:3.0:1790778956.621116:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1790778956.621126:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2343:x1877767510644992:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778956.621139:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00100000:1.0:1790778956.621146:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2343:x1877767510645120:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778956.621202:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4dac8e38-11f9-42ba-9bac-432079f13049+5:2343:x1877767510645120:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 56us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.621210:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00080000:2.0:1790778956.621227:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778956.621387:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510644864 00000100:00100000:0.0:1790778956.621392:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510644864 00000100:00100000:0.0:1790778956.621438:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 297 00000100:00100000:0.0:1790778956.621482:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510644864:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778956.623622:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2343:x1877767510644992:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 2474us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778956.623652:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:0.0:1790778956.627627:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510644864:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 6133us (6881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.627643:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 297 00000100:00100000:2.0:1790778956.723539:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.724340:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510645248 00000100:00100000:1.0:1790778956.724418:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510645248 00000100:00100000:0.0:1790778956.725806:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:0.0:1790778956.725822:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+39:11479:x1877767510645248:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778956.725872:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778956.725895:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607567a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dceea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.725992:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.726012:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.726026:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778956.726095:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790778956.726099:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778956.726120:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.726144:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607567a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceea expref: 41 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.726163:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceea expref: 40 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.726174:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778956.726177:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778956.726180:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0600, rc 0) 00000100:00100000:0.0:1790778956.726250:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+40:11479:x1877767510645248:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 432us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.726256:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:3.0:1790778956.733427:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.734277:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510645504 00000100:00100000:2.0:1790778956.734293:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510645504 00000100:00100000:2.0:1790778956.734371:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 205 00000100:00100000:2.0:1790778956.734382:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+40:11479:x1877767510645504:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778956.734409:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778956.734434:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcef1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.734598:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc8763265607568f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.734612:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc8763265607568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.734622:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc8763265607568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778956.734634:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790778956.734732:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef1 expref: 43 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.734745:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc8763265607568f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef1 expref: 42 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.734752:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:2.0:1790778956.734754:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778956.734771:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4a00, rc 0) 00000100:00100000:2.0:1790778956.734829:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+42:11479:x1877767510645504:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 449us (1414us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1790778956.734836:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 205 00000100:00100000:1.0:1790778956.738596:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.738999:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510645760 00000100:00100000:2.0:1790778956.739010:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510645760 00000100:00100000:2.0:1790778956.739077:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:2.0:1790778956.739088:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+42:11479:x1877767510645760:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778956.739119:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778956.739141:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc8763265607569d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcef8 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.739257:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc876326560756a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.739270:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc876326560756a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.739280:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc876326560756a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778956.739293:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790778956.739409:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc8763265607569d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef8 expref: 45 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.739431:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc876326560756a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef8 expref: 44 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.739731:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:2.0:1790778956.739751:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790778956.739756:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5600, rc 0) 00000100:00100000:2.0:1790778956.739992:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2330ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+44:11479:x1877767510645760:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 904us (1406us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1790778956.740002:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:2.0:1790778956.740198:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.740347:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510645888 00000100:00100000:0.0:1790778956.740356:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510645888 00000100:00100000:0.0:1790778956.740422:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1790778956.740431:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+44:2344:x1877767510645888:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778956.740472:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778956.740668:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc8763265607568f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef1 expref: 44 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.740685:0:5933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:0.0:1790778956.740690:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778956.740767:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53b344e-0d4c-4209-a606-d24036760c61+43:2344:x1877767510645888:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 337us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.740775:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1790778956.747650:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.747752:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510646016 00000100:00100000:1.0:1790778956.747766:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510646016 00000100:00100000:1.0:1790778956.747876:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1790778956.747886:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510646016:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:1.0:1790778956.747938:0:6935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.747961:0:6935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 8 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.747970:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778956.747975:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778956.747980:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.748019:0:6935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 8 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.748038:0:6935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 8 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.748056:0:6935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef205c03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6935:1877767531607168:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778956.748205:0:6935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778956.753345:0:6935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef205c03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6935:1877767531607168:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778956.753378:0:6935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.754269:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.754344:0:6940:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510646144 00000100:00100000:1.0:1790778956.754350:0:6940:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510646144 00002000:00100000:1.0:1790778956.754399:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ef2369adc00 x1877767510646144/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:507/0 lens 504/0 e 0 to 0 dl 1790778967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778956.754424:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2369adc00 with x1877767510646144 ext(0->8) 00010000:00010000:1.0:1790778956.754432:0:6940:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 9 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.754571:0:6940:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 9 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778956.754579:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef2369adc00 00000100:00100000:1.0:1790778956.754602:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1790778956.754611:0:6940:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510646144:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:1.0:1790778956.755503:0:6940:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+11:2345:x1877767510646144:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 890us (1232us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790778956.755513:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00002000:00100000:1.0:1790778956.755523:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ef2369adc00 x1877767510646144/t4294967308(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:507/0 lens 504/448 e 0 to 0 dl 1790778967 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778956.755531:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2369adc00 with x1877767510646144 ext(0->8) 00010000:00010000:1.0:1790778956.755538:0:6940:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 11 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.755551:0:6940:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 11 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790778956.755559:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ef2369adc00 00000100:00100000:1.0:1790778956.758215:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.758595:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510646272 00000100:00100000:0.0:1790778956.758607:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510646272 00010000:00010000:0.0:1790778956.758659:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 11 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778956.758757:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:0.0:1790778956.758765:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+11:2346:x1877767510646272:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778956.758779:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790778956.758796:0:12059:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790778956.758798:0:12059:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790778956 00002000:00010000:0.0:1790778956.758800:0:12059:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790778956 00002000:00010000:0.0:1790778956.758802:0:12059:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790778956 00002000:00010000:0.0:1790778956.758803:0:12059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1790778956.758808:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 11 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.758824:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 11 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.758842:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd1de9f/0xdc87632656075673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcee3 expref: 11 pid: 6934 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.758867:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778956.758872:0:12059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778956.758877:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.758888:0:12059:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.758921:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778956.758981:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+10:2346:x1877767510646272:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 215us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.758989:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00010000:00010000:1.0:1790778956.759059:0:6935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759069:0:6935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759091:0:6935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759100:0:6935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759108:0:6935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759116:0:6935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165ae00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790778956.759120:0:6935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759130:0:6935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759142:0:6935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.759150:0:6935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc876326560756b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.759224:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+9:2346:x1877767510646016:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 11339us (11786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.759232:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1790778956.762068:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778956.762164:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510646528 00000100:00100000:3.0:1790778956.762173:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510646528 00000100:00100000:3.0:1790778956.762219:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:3.0:1790778956.762228:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f7b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+43:11479:x1877767510646528:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1790778956.762286:0:5952:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc876326560756a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef8 expref: 43 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790778956.762499:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1790778956.762536:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1790778956.762764:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1790778956.762791:0:5952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.762801:0:5952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 47 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.762808:0:5952:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.762833:0:5952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 47 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778956.762843:0:5952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 47 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778956.762856:0:5952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5952:1877767531607296:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778956.762948:0:5952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905480 going to sleep for 11 seconds 00000100:00100000:1.0:1790778956.765789:0:5952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5952:1877767531607296:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790778956.765825:0:5952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.768248:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778956.768313:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510646656 00000100:00100000:2.0:1790778956.768327:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510646656 00010000:00010000:2.0:1790778956.768560:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 48 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778956.768602:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:2.0:1790778956.768613:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+48:2345:x1877767510646656:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778956.768636:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778956.768644:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 48 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.768656:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 48 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.768675:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607565e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dced5 expref: 48 pid: 5949 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.768703:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:2.0:1790778956.768707:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.768716:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.768724:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778956.768752:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778956.768826:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+47:2345:x1877767510646656:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 215us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778956.768834:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00010000:00010000:1.0:1790778956.769957:0:5952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.769970:0:5952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790778956.770121:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1790778956.770255:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1790778956.770400:0:5952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236847480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531607424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790778956.770531:0:5952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778956.770562:0:5952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778956.770641:0:5954:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531607424 00000100:00100000:3.0:1790778956.770650:0:5954:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531607424 00000100:00100000:3.0:1790778956.770709:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790778956.770719:0:5954:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5952:x1877767531607424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790778956.770888:0:5954:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5952:x1877767531607424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 164us (350us total) trans 0 rc 0/0 00000100:00080000:2.0:1790778956.770888:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778956.770896:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790778956.772077:0:5952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236847480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531607424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790778956.772298:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1790778956.772382:0:5952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236847480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531607552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790778956.772438:0:5952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778956.772602:0:5952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790778956.772647:0:5954:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531607552 00000100:00100000:3.0:1790778956.772654:0:5954:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531607552 00000100:00100000:3.0:1790778956.773348:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790778956.773360:0:5954:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5952:x1877767531607552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790778956.773663:0:5954:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5952:x1877767531607552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 305us (1225us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790778956.773673:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790778956.773771:0:5952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236847480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5952:1877767531607552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790778956.773853:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1790778956.773917:0:5952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.773930:0:5952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.773937:0:5952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.773943:0:5952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014abc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.773949:0:5952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.773957:0:5952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.773975:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:1.0:1790778956.773979:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790778956.773984:0:5952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.773991:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014abc00/0xdc876326560756b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790778956.774252:0:5952:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790778956.774331:0:5952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1790778956.774347:0:5952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350649903802ns, next at 351649900553ns, rc = 0 00000001:00080000:1.0:1790778956.774355:0:5952:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1790778956.774380:0:5952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef2363a9d00) 00010000:00010000:1.0:1790778956.774384:0:5952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790778956.774400:0:5952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc876326560756a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcef8 expref: 51 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.774680:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f7b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+50:11479:x1877767510646528:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 12452us (12619us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790778956.774690:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000020:00080000:1.0:1790778956.774695:0:5952:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790778956.778241:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.781763:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510646784 00000100:00100000:0.0:1790778956.781778:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510646784 00000100:00100000:0.0:1790778956.781836:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:0.0:1790778956.781845:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+50:11479:x1877767510646784:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778956.781984:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778956.782011:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc876326560756c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dceff expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.782083:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc876326560756c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceff expref: 51 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.782098:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc876326560756c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceff expref: 51 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.782181:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778956.782185:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790778956.782189:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1400, rc 0) 00000100:00100000:0.0:1790778956.782304:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+51:11479:x1877767510646784:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 459us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.782310:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:3.0:1790778956.787990:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.788623:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510647040 00000100:00100000:0.0:1790778956.788637:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510647040 00000100:00100000:0.0:1790778956.788702:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1790778956.788713:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+51:11479:x1877767510647040:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1790778956.790294:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+52:11479:x1877767510647040:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 1571us (2415us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790778956.790310:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1790778956.882534:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.882691:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510647168 00000100:00100000:1.0:1790778956.882702:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510647168 00000100:00100000:1.0:1790778956.882772:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:1.0:1790778956.882783:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+52:11489:x1877767510647168:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1790778956.882888:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.882906:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.882919:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.882932:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.882939:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.882944:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883022:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883042:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883049:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778956.883096:0:5950:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883108:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883115:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883122:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883128:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165ae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.883133:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883140:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883152:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778956.883156:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.883161:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883167:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc876326560756c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883190:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883196:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883201:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883207:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.883210:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883216:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883224:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef215c54300) 00010000:00010000:1.0:1790778956.883227:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.883230:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883235:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc876326560756ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883252:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883258:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883263:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883274:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778956.883277:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883282:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883290:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:1.0:1790778956.883292:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778956.883295:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778956.883300:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560756d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778956.883394:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+52:11489:x1877767510647168:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 613us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778956.883402:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:2.0:1790778956.931055:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.931219:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510647424 00000100:00100000:0.0:1790778956.931231:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510647424 00000100:00100000:0.0:1790778956.931300:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:0.0:1790778956.931311:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+52:11492:x1877767510647424:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778956.931337:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778956.931361:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560756dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf06 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931546:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931564:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931576:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931592:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931599:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931607:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931747:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560756f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931755:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560756f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931762:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560756f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778956.931772:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790778956.931858:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931877:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931884:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931890:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778956.931894:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931902:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931914:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778956.931917:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778956.931922:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931929:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc876326560756e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931942:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931947:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931952:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931956:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778956.931964:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931970:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931978:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef203c61400) 00010000:00010000:0.0:1790778956.931981:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778956.931983:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.931989:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc876326560756ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.932036:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc876326560756dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf06 expref: 55 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.932050:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560756f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf06 expref: 54 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.932057:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778956.932059:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778956.932062:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1200, rc 0) 00000100:00100000:0.0:1790778956.933279:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+54:11492:x1877767510647424:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 815us (1082us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1790778956.933294:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:3.0:1790778956.936237:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778956.936350:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510647552 00000100:00100000:0.0:1790778956.936360:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510647552 00000100:00100000:0.0:1790778956.936422:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:0.0:1790778956.936433:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+54:11492:x1877767510647552:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1790778956.936547:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936562:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936573:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936609:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936616:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936624:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936630:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778956.936634:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936642:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936653:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778956.936657:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778956.936661:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778956.936668:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc876326560756ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778956.936761:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+54:11492:x1877767510647552:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 329us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778956.936768:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:2.0:1790778956.941422:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778956.941626:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510647808 00000100:00100000:1.0:1790778956.941636:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510647808 00000100:00100000:1.0:1790778956.942609:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:1.0:1790778956.942626:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+54:11492:x1877767510647808:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1790778956.942903:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+55:11492:x1877767510647808:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 282us (1489us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1790778956.942911:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:3.0:1790778957.045589:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.045648:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510648064 00000100:00100000:0.0:1790778957.045660:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510648064 00000100:00100000:0.0:1790778957.045749:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:0.0:1790778957.045759:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+55:11502:x1877767510648064:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1790778957.045786:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.045790:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790778957.045817:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceea expref: 55 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.045836:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778957.045841:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790778957.045853:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075706 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf0d expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.045973:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc8763265607570d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.045988:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc8763265607570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.045999:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc8763265607570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778957.046012:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790778957.046544:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075706 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf0d expref: 57 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.046578:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc8763265607570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf0d expref: 56 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.046587:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.046589:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778957.046592:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0a00, rc 0) 00000100:00100000:0.0:1790778957.046649:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+56:11502:x1877767510648064:12345-192.168.202.2@tcp:101:bash.0 Request processed in 892us (1071us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1790778957.046657:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00080000:2.0:1790778957.046952:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778957.051580:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.051670:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510648192 00000100:00100000:2.0:1790778957.051681:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510648192 00000100:00100000:2.0:1790778957.051739:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:2.0:1790778957.051748:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+56:11502:x1877767510648192:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790778957.051775:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778957.051795:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607571b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf14 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.051828:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.051859:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.051872:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.051996:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc8763265607571b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 58 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.052013:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 57 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.052022:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778957.052026:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790778957.052029:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4e00, rc 0) 00000100:00100000:2.0:1790778957.052088:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+57:11502:x1877767510648192:12345-192.168.202.2@tcp:101:bash.0 Request processed in 340us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.052096:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:2.0:1790778957.056165:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.056697:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510648320 00000100:00100000:3.0:1790778957.056709:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510648320 00000100:00100000:3.0:1790778957.056777:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790778957.056788:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240df5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+57:2345:x1877767510648320:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778957.056802:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778957.056827:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc8763265607570d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf0d expref: 57 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.056847:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778957.056867:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778957.056954:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240df5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+56:2345:x1877767510648320:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 166us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.056962:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790778957.061341:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778957.061688:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510648576 00000100:00100000:1.0:1790778957.061699:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510648576 00000100:00100000:1.0:1790778957.061765:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:1.0:1790778957.061793:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+56:11502:x1877767510648576:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1790778957.061855:0:5950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778957.061893:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc876326560756f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf06 expref: 56 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.061914:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:1.0:1790778957.061920:0:5950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778957.062127:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.062143:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.062153:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790778957.062199:0:5950:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1790778957.062223:0:5950:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008fd62bf0 reply state 00000000da5f129c transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.062233:0:5950:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790778957.062339:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+58:11502:x1877767510648576:12345-192.168.202.2@tcp:36:bash.0 Request processed in 549us (1013us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1790778957.062347:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 213 00000020:00080000:1.0:1790778957.062353:0:5950:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790778957.068515:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.068539:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.068547:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.068554:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778957.068579:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.068588:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.068610:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778957.068613:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778957.068619:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.068626:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b600/0xdc87632656075729 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.076143:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778957.076438:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510648704 00000100:00100000:1.0:1790778957.076483:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510648704 00000100:00100000:1.0:1790778957.076565:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:1.0:1790778957.076577:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+57:11502:x1877767510648704:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1790778957.076621:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790778957.076643:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc87632656075730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf1b expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.076733:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.076748:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.076759:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790778957.076787:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790778957.076791:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790778957.076811:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.076835:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc87632656075730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 59 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.076854:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 58 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.076862:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:1.0:1790778957.076866:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778957.076869:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165aa00, rc 0) 00000100:00100000:1.0:1790778957.076950:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+58:11502:x1877767510648704:12345-192.168.202.2@tcp:101:bash.0 Request processed in 375us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778957.076959:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:1.0:1790778957.084083:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.084196:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510648960 00000100:00100000:0.0:1790778957.084207:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510648960 00000100:00100000:0.0:1790778957.084276:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1790778957.084289:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+58:11502:x1877767510648960:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:0.0:1790778957.084586:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+59:11502:x1877767510648960:12345-192.168.202.2@tcp:35:bash.0 Request processed in 298us (513us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1790778957.084594:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:3.0:1790778957.176221:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.176677:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510649088 00000100:00100000:0.0:1790778957.176688:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510649088 00000100:00100000:0.0:1790778957.176752:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:0.0:1790778957.176763:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+59:11508:x1877767510649088:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778957.176793:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.176813:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607573e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf22 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.176901:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.176917:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.176930:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778957.176976:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790778957.176980:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778957.176995:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.177019:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc8763265607573e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf22 expref: 61 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.177036:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf22 expref: 60 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.177044:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778957.177046:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790778957.177050:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0600, rc 0) 00000100:00100000:0.0:1790778957.177120:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510649088:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 358us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.177129:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:3.0:1790778957.180964:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.181301:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510649216 00000100:00100000:0.0:1790778957.181312:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510649216 00000100:00100000:0.0:1790778957.181402:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:0.0:1790778957.181415:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510649216:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778957.181467:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.181500:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607574c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf29 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181576:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181591:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181602:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181616:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181622:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181628:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181698:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181707:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181714:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778957.181772:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790778957.181776:0:7119:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790778957.181810:0:7119:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181822:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181832:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181839:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181847:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181853:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778957.181857:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181865:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181878:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:0.0:1790778957.181881:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778957.181887:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181893:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181917:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181924:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181930:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181936:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778957.181939:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181945:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181953:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef203c61400) 00010000:00010000:0.0:1790778957.181956:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790778957.181959:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181965:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc8763265607575a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.181995:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc8763265607574c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf29 expref: 62 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.182004:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf29 expref: 61 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.182016:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.182018:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790778957.182020:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1800, rc 0) 00000100:00100000:0.0:1790778957.182075:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+61:11508:x1877767510649216:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 664us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.182083:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:3.0:1790778957.196616:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.196827:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510649344 00000100:00100000:0.0:1790778957.196838:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510649344 00000100:00100000:0.0:1790778957.196907:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1790778957.196919:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+61:2346:x1877767510649344:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778957.196934:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778957.196959:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf29 expref: 61 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.196979:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.196984:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778957.197044:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+60:2346:x1877767510649344:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 128us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.197052:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1790778957.197098:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.197195:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510649600 00000100:00100000:0.0:1790778957.197200:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510649600 00000100:00100000:0.0:1790778957.197227:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:0.0:1790778957.197234:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510649600:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1790778957.197252:0:12797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.197282:0:12797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf30 expref: -99 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.197402:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.197417:0:12797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 61 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.197426:0:12797:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.197479:0:12797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 61 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.197504:0:12797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 61 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.197518:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531607680:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778957.197601:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790778957.202353:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531607680:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778957.202382:0:12797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.208331:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.208625:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510649728 00000100:00100000:2.0:1790778957.208637:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510649728 00010000:00010000:2.0:1790778957.208682:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 62 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.208717:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:2.0:1790778957.208728:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+62:2343:x1877767510649728:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778957.208747:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778957.208754:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 62 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.208768:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 62 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.208816:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165aa00/0xdc87632656075737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf1b expref: 62 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.208836:0:5934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778957.208841:0:5934:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.208855:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.208863:0:5934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.208908:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790778957.208960:0:12797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.208970:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.208972:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+61:2343:x1877767510649728:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 246us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.208980:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000004:00200000:3.0:1790778957.208991:0:12797:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790778957.209418:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0a00/0xdc87632656075768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 62 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.209438:0:12797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 61 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.209471:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778957.209474:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790778957.209559:0:12797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0400, rc 0) 00000100:00100000:3.0:1790778957.209648:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+61:11508:x1877767510649600:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 12414us (12548us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1790778957.209656:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:3.0:1790778957.222681:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.225627:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510649984 00000100:00100000:0.0:1790778957.225642:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510649984 00000100:00100000:0.0:1790778957.225730:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1790778957.225741:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+61:11508:x1877767510649984:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:0.0:1790778957.225759:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778957.225786:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1400/0xdc876326560756c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dceff expref: 61 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.225809:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.225830:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778957.225908:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510649984:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 168us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.225916:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1790778957.229702:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.230025:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510650112 00000100:00100000:0.0:1790778957.230037:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510650112 00000100:00100000:1.0:1790778957.230251:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:1.0:1790778957.230272:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510650112:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:1.0:1790778957.230397:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.230415:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.230426:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790778957.230558:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1790778957.230643:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510650112:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 383us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778957.230652:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:1.0:1790778957.234718:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.234775:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510650240 00000100:00100000:2.0:1790778957.234848:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510650240 00000100:00100000:2.0:1790778957.234911:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:2.0:1790778957.234921:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+60:11508:x1877767510650240:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790778957.234945:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778957.234965:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf37 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.235019:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.235060:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 61 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.235078:0:5949:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.235092:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 61 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.235106:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778957.235109:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790778957.235112:0:5949:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 61 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.235119:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5200, rc 0) 00000100:00100000:2.0:1790778957.235186:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+61:11508:x1877767510650240:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 266us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.235193:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 219 00000040:00080000:2.0:1790778957.451683:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778957.451694:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778957.451743:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790778957.451764:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790778957.451916:0:12077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531607808:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790778957.452108:0:12077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1790778957.456478:0:12077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531607808:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790778957.462946:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.463031:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510650368 00000100:00100000:2.0:1790778957.463052:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510650368 00000100:00100000:2.0:1790778957.463102:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:2.0:1790778957.463110:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+61:11509:x1877767510650368:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790778957.463348:0:12797:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790778957.463463:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+61:11509:x1877767510650368:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 353us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.463469:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:1.0:1790778957.469220:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.469384:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510650496 00000100:00100000:2.0:1790778957.469395:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510650496 00000100:00100000:2.0:1790778957.469508:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:2.0:1790778957.469520:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+61:11509:x1877767510650496:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790778957.469603:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469621:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469633:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469699:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469707:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469713:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469745:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469772:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469779:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778957.469830:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790778957.469834:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778957.469846:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469857:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469864:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469872:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469877:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778957.469881:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469888:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469899:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:2.0:1790778957.469902:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778957.469906:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469924:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc8763265607578b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469937:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469943:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469948:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469952:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778957.469956:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469961:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469969:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ef2363a9800) 00010000:00010000:2.0:1790778957.469971:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778957.469973:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469979:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075792 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469992:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.469997:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.470008:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.470013:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778957.470016:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.470021:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.470028:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778957.470031:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778957.470033:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.470038:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc87632656075799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.470305:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+61:11509:x1877767510650496:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 785us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.470313:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:3.0:1790778957.479726:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.481800:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510650752 00000100:00100000:0.0:1790778957.481819:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510650752 00000100:00100000:0.0:1790778957.481898:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:0.0:1790778957.481911:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+61:11509:x1877767510650752:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778957.481942:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.481973:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031c00/0xdc876326560757a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf3e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482118:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482149:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482162:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790778957.482177:0:5950:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790778957.482274:0:5950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482283:0:5950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482290:0:5950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482313:0:5950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790778957.482318:0:5950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482326:0:5950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482339:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.482342:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790778957.482346:0:5950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482353:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031400/0xdc876326560757a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482396:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031c00/0xdc876326560757a0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf3e expref: 63 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482407:0:5950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:0.0:1790778957.482409:0:5950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790778957.482413:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef200031c00/0xdc876326560757a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf3e expref: 63 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.482422:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef200031c00, rc 0) 00000100:00100000:0.0:1790778957.482516:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+62:11509:x1877767510650752:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 608us (2801us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1790778957.482524:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:1.0:1790778957.486858:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.486969:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510650880 00000100:00100000:2.0:1790778957.486981:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510650880 00000100:00100000:2.0:1790778957.487057:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:2.0:1790778957.487070:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+62:11509:x1877767510650880:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790778957.487123:0:12797:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790778957.487540:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+62:11509:x1877767510650880:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 470us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.487574:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:1.0:1790778957.492036:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.492315:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510651136 00000100:00100000:2.0:1790778957.492330:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510651136 00000100:00100000:2.0:1790778957.492420:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:2.0:1790778957.492432:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+62:11509:x1877767510651136:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778957.492501:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778957.492507:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790778957.492540:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0600/0xdc87632656075745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf22 expref: 62 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.492562:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:2.0:1790778957.492567:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790778957.492583:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf45 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790778957.493049:0:5951:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790778957.494763:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560757bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.494795:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560757bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.494808:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560757bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.494893:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf45 expref: 64 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.494946:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560757bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf45 expref: 63 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.494955:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9800) 00010000:00010000:2.0:1790778957.494958:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778957.494963:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5000, rc 0) 00000100:00100000:2.0:1790778957.495069:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+63:11509:x1877767510651136:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2638us (3045us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1790778957.495080:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:0.0:1790778957.506331:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778957.506491:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510651392 00000100:00100000:1.0:1790778957.506505:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510651392 00000100:00100000:1.0:1790778957.506577:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:1.0:1790778957.506588:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+63:11509:x1877767510651392:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790778957.506660:0:7119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778957.506690:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc876326560757bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf45 expref: 63 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506717:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9800) 00010000:00010000:1.0:1790778957.506728:0:7119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778957.506750:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506768:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506780:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506795:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506801:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506805:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506844:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506848:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506852:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506858:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778957.506863:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506981:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.506990:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778957.506992:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778957.506995:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507000:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc876326560757ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507008:0:7119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507012:0:7119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507016:0:7119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507019:0:7119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790778957.507020:0:7119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507024:0:7119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507027:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5a67df16 (ffff9ef215c54300) 00010000:00010000:1.0:1790778957.507029:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778957.507030:0:7119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.507042:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b200/0xdc876326560757d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5a67df16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.507161:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+62:11509:x1877767510651392:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 574us (838us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790778957.507168:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:1.0:1790778957.510002:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.510252:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510651520 00000100:00100000:2.0:1790778957.510267:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510651520 00000100:00100000:2.0:1790778957.510405:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:2.0:1790778957.510418:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+62:11509:x1877767510651520:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778957.510517:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778957.510550:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf4c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.510600:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.510616:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.510636:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.510825:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 64 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.510854:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 63 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.510864:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:2.0:1790778957.510867:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790778957.510871:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4200, rc 0) 00000100:00100000:2.0:1790778957.510956:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+63:11509:x1877767510651520:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 540us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.510964:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:0.0:1790778957.513675:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.513752:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510651776 00000100:00100000:2.0:1790778957.513766:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510651776 00000100:00100000:2.0:1790778957.513835:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:2.0:1790778957.513848:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+63:11509:x1877767510651776:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790778957.514070:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.514089:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.514103:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790778957.514346:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1790778957.514357:0:5951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351389913758ns, next at 352389910916ns, rc = 0 00000004:00010000:2.0:1790778957.514416:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3ffb6f0 reply state 00000000e1e54822 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.514596:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790778957.517453:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+65:11509:x1877767510651776:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 3580us (3763us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790778957.517467:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:1.0:1790778957.526045:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.526101:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510651904 00000100:00100000:3.0:1790778957.526112:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510651904 00000100:00100000:3.0:1790778957.526373:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 228 00000100:00100000:3.0:1790778957.526386:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+65:11509:x1877767510651904:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778957.526420:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778957.526465:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf53 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.526556:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 66 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.526572:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.526599:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.526609:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.526611:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 66 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.526617:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778957.526622:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.526631:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.526634:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:3.0:1790778957.526637:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790778957.526641:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:3.0:1790778957.526719:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+66:11509:x1877767510651904:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 336us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.526726:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 228 00010000:00010000:2.0:1790778957.529160:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:2.0:1790778957.529176:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790778957.529187:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.529201:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.530203:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.530299:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510652032 00000100:00100000:2.0:1790778957.530312:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510652032 00000100:00100000:0.0:1790778957.530547:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1790778957.530560:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2346:x1877767510652032:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790778957.530802:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+10:2346:x1877767510652032:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 245us (702us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790778957.530808:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00080000:3.0:1790778957.530962:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778957.536929:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.537061:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510652288 00000100:00100000:2.0:1790778957.537074:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510652288 00000100:00100000:2.0:1790778957.537154:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:2.0:1790778957.537165:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+65:11509:x1877767510652288:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790778957.537401:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+66:11509:x1877767510652288:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 237us (482us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790778957.537408:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1790778957.540550:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.540644:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510652544 00000100:00100000:3.0:1790778957.540654:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510652544 00000100:00100000:3.0:1790778957.540717:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:3.0:1790778957.540728:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+66:11509:x1877767510652544:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790778957.540865:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+66:11509:x1877767510652544:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.540881:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:0.0:1790778957.547557:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.547666:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510652672 00000100:00100000:2.0:1790778957.547677:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510652672 00000100:00100000:2.0:1790778957.547745:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 230 00000100:00100000:2.0:1790778957.547756:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+66:11509:x1877767510652672:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778957.547784:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778957.547806:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf5a expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.547910:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.547926:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.547936:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778957.547980:0:5951:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790778957.548000:0:5951:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.548026:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5c00/0xdc876326560757f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf5a expref: 68 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.548053:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf5a expref: 67 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.548061:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:2.0:1790778957.548064:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790778957.548068:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5800, rc 0) 00000100:00100000:2.0:1790778957.548544:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+67:11509:x1877767510652672:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 788us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.548557:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 230 00000100:00100000:0.0:1790778957.551712:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.551797:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510652800 00000100:00100000:3.0:1790778957.551807:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510652800 00000100:00100000:3.0:1790778957.551864:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:3.0:1790778957.551989:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+10:2346:x1877767510652800:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790778957.552014:0:6934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778957.552056:0:6934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf61 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790778957.552091:0:6934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1e4d, blocks: 0x0 00010000:00010000:3.0:1790778957.552276:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1790778957.552281:0:6934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790778957.552294:0:6934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 11 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.552317:0:6934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 11 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.552332:0:6934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:3.0:1790778957.552468:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+11:2346:x1877767510652800:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 570us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.552476:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1790778957.559784:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.560142:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653056 00000100:00100000:3.0:1790778957.560172:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653056 00000100:00100000:3.0:1790778957.560243:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:3.0:1790778957.560254:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+67:11509:x1877767510653056:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790778957.560392:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+67:11509:x1877767510653056:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 139us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.560401:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:0.0:1790778957.565325:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.565432:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653184 00000100:00100000:3.0:1790778957.565599:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653184 00000100:00100000:0.0:1790778957.565705:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:0.0:1790778957.565713:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+11:11509:x1877767510653184:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790778957.565730:0:6937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790778957.565749:0:6937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf68 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.565783:0:6937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.565790:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778957.565794:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790778957.565798:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 12 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.565826:0:6937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.565852:0:6937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.565865:0:6937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6937:1877767531607936:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778957.566142:0:6937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1790778957.568972:0:6937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6937:1877767531607936:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778957.569020:0:6937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 12 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.569059:0:6937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef200030c00, rc 0) 00000100:00100000:0.0:1790778957.569353:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+12:11509:x1877767510653184:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3638us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.569364:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1790778957.571777:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.571948:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653312 00000100:00100000:2.0:1790778957.571958:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653312 00010000:00010000:2.0:1790778957.572009:0:5934:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.572218:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:2.0:1790778957.572230:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+12:2345:x1877767510653312:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778957.572246:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778957.572271:0:5934:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.572287:0:5934:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.572310:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075802 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf61 expref: 12 pid: 6934 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.572353:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778957.572357:0:5934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778957.572367:0:5934:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 11 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.572377:0:5934:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 11 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.572420:0:5934:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 11 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.572436:0:5934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5934:1877767531608064:192.168.202.2@tcp:105: 00000100:00100000:2.0:1790778957.572579:0:5934:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778957.575753:0:5934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5934:1877767531608064:192.168.202.2@tcp:105: 00010000:00010000:2.0:1790778957.575782:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778957.575831:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53b344e-0d4c-4209-a606-d24036760c61+11:2345:x1877767510653312:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3604us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.575841:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:1.0:1790778957.578430:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.578564:0:6941:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653440 00000100:00100000:2.0:1790778957.578576:0:6941:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653440 00002000:00100000:2.0:1790778957.578633:0:6941:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ef236b77100 x1877767510653440/t0(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:508/0 lens 504/0 e 0 to 0 dl 1790778968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790778957.578645:0:6941:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236b77100 with x1877767510653440 ext(0->12) 00002000:00010000:2.0:1790778957.578651:0:6941:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236b77100 00000100:00100000:2.0:1790778957.578694:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:2.0:1790778957.578706:0:6941:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b53b344e-0d4c-4209-a606-d24036760c61+11:2345:x1877767510653440:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00010000:00010000:1.0:1790778957.579651:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778957.580348:0:6941:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:2345:x1877767510653440:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 1639us (1921us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1790778957.580362:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00002000:00100000:2.0:1790778957.580376:0:6941:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ef236b77100 x1877767510653440/t4294967320(0) o4->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:508/0 lens 504/448 e 0 to 0 dl 1790778968 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790778957.580386:0:6941:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef236b77100 with x1877767510653440 ext(0->12) 00002000:00010000:2.0:1790778957.580392:0:6941:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef236b77100 00000100:00100000:1.0:1790778957.583219:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.583332:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653568 00000100:00100000:0.0:1790778957.583343:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653568 00000100:00100000:0.0:1790778957.583404:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 232 00000100:00100000:0.0:1790778957.583414:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+67:11509:x1877767510653568:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790778957.586630:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1790778957.586648:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1790778957.586748:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790778957.586785:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef204006300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790778957.586790:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef235cf6000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef204006b40 00000020:00080000:2.0:1790778957.586794:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef235cf6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2368a4000 00000004:00080000:2.0:1790778957.586820:0:5927:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:1.0:1790778957.586951:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531608192:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790778957.587019:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778957.587083:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531608192 00000100:00100000:1.0:1790778957.587091:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531608192 00000100:00100000:1.0:1790778957.587149:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790778957.587159:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3440:x1877767531608192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790778957.587191:0:6935:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1790778957.587226:0:6935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd1e4c, atime: 0x6abd1e4c, ctime: 0x6abd1e4c, blocks: 0x8 00010000:00010000:1.0:1790778957.587235:0:6935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587254:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1790778957.587268:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778957.587275:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587296:0:6935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587307:0:6935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587316:0:6935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587334:0:6935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790778957.587538:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3440:x1877767531608192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 380us (518us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790778957.587546:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1790778957.587571:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778957.587579:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587587:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165ae00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790778957.587592:0:5936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587602:0:5936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587635:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587643:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b837f52/0xdc87632656075810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.587664:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778957.587666:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778957.587668:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790778957.587700:0:3440:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236b77800/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790778957.587707:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531608192:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1790778957.587854:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790778957.588129:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531608448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790778957.588171:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778957.588206:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790778957.588212:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531608320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790778957.588233:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778957.588348:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531608448 00000100:00100000:0.0:1790778957.588354:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531608448 00000100:00100000:0.0:1790778957.588410:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531608320 00000100:00100000:0.0:1790778957.588414:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531608320 00000100:00100000:0.0:1790778957.588430:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790778957.588439:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531608448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790778957.588588:0:12307:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790778957.588602:0:12307:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790778957 00002000:00010000:0.0:1790778957.588605:0:12307:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790778957.588608:0:12307:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790778957 -> 1790778957 00002000:00010000:0.0:1790778957.588611:0:12307:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1790778957.588654:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3442:x1877767531608448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (481us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1790778957.588661:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1790778957.588854:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790778957.588958:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790778957.588966:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3442:x1877767531608320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790778957.588981:0:12307:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1790778957.588997:0:12307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.589014:0:12307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 12 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.589022:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790778957.589026:0:12307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790778957.589030:0:12307:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.589058:0:12307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 12 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.589075:0:12307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 12 pid: 6935 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.589175:0:12307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12307:1877767531608576:192.168.202.2@tcp:104: 00000100:00100000:0.0:1790778957.589297:0:12307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2062c8540 going to sleep for 11 seconds 00000004:00080000:0.0:1790778957.589332:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236b7c000/2, rc 0, transno 4294967321 00000100:00100000:0.0:1790778957.589338:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531608448:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1790778957.589616:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef204006540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790778957.589621:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef235cf6e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef204006600 00000020:00080000:2.0:1790778957.589624:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef235cf6700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2364f0200 00000100:00100000:0.0:1790778957.589799:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+21:11509:x1877767510653568:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 6386us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.589808:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 232 00000020:00080000:1.0:1790778957.591584:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1790778957.591699:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790778957.596229:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.596315:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653696 00000100:00100000:0.0:1790778957.596325:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653696 00000100:00100000:0.0:1790778957.596389:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1790778957.596399:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+13:2346:x1877767510653696:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790778957.598349:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1790778957.598365:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1790778957.598562:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510653696:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 2159us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778957.598572:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1790778957.602083:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778957.602323:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510653952 00000100:00100000:1.0:1790778957.602333:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510653952 00000100:00100000:1.0:1790778957.602400:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:1.0:1790778957.602413:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+21:11509:x1877767510653952:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790778957.602521:0:5951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778957.602551:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5800/0xdc876326560757fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf5a expref: 21 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.602597:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:1.0:1790778957.602603:0:5951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790778957.602636:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.602651:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.602661:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790778957.602801:0:5951:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d7f8bec8 reply state 00000000780c503b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.602811:0:5951:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790778957.602925:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+22:11509:x1877767510653952:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 515us (853us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1790778957.602933:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:0.0:1790778957.603264:0:12307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12307:1877767531608576:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790778957.603289:0:12307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606382:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606399:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606425:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606431:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165ae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778957.606436:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606478:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606503:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:2.0:1790778957.606507:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790778957.606511:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.606518:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165ae00/0xdc8763265607581e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.606794:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.607332:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510654080 00000100:00100000:2.0:1790778957.607342:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510654080 00000100:00100000:2.0:1790778957.607394:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1790778957.607403:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2343:x1877767510654080:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790778957.607598:0:6934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790778957.607602:0:6934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790778957 -> 1790778957 00002000:00010000:2.0:1790778957.607605:0:6934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790778956 00002000:00010000:2.0:1790778957.607607:0:6934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790778957 -> 1790778957 00002000:00010000:2.0:1790778957.607610:0:6934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790778957.607660:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+9:2343:x1877767510654080:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 257us (870us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790778957.607674:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1790778957.611319:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.611374:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.611498:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510654464 00000100:00100000:2.0:1790778957.611512:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510654464 00010000:00010000:2.0:1790778957.611572:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 9 pid: 6935 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.611620:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1790778957.611631:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2346:x1877767510654464:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778957.611652:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778957.611661:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 9 pid: 6935 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.611676:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 9 pid: 6935 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.611704:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa208bbb/0xdc876326560755c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcec0 expref: 9 pid: 6935 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.611723:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790778957.611727:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790778957.611732:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.611743:0:5935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.611812:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778957.611868:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2346:x1877767510654464:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 239us (493us total) trans 0 rc 0/0 00010000:00010000:1.0:1790778957.611992:0:12307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.612003:0:12307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.612013:0:12307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.612032:0:12307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.612049:0:12307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790778957.612265:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3442:x1877767531608320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23299us (24030us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1790778957.612274:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790778957.612601:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:0.0:1790778957.612709:0:3442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1790778957.612716:0:3442:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1790778957.612742:0:3442:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236b7c000, transno 4294967321 00000100:00100000:0.0:1790778957.612769:0:3442:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ef236b7d180 x1877767531608320/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790778973 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790778957.612790:0:3442:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236b7d180/2, rc 0, transno 4294967323 00000100:00100000:0.0:1790778957.612795:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531608320:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790778957.613414:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778957.613425:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613438:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778957.613475:0:6950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613497:0:6950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613519:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613535:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d46dcca/0xdc87632656075817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613561:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778957.613564:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778957.613566:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778957.613587:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510654336 00000100:00100000:3.0:1790778957.613597:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510654336 00000100:00100000:3.0:1790778957.613655:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:3.0:1790778957.613665:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+21:11509:x1877767510654336:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790778957.613754:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613771:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613781:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613819:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 21 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.613834:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 21 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.613849:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531608704:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778957.613967:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905300 going to sleep for 11 seconds 00000100:00100000:0.0:1790778957.620294:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778957.620493:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510654592 00000100:00100000:1.0:1790778957.620503:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510654592 00010000:00010000:1.0:1790778957.620551:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 22 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.620591:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:1.0:1790778957.620602:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+22:2345:x1877767510654592:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790778957.620619:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778957.620627:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 22 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.620642:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 22 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.620669:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:1.0:1790778957.620676:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.620686:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.620710:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.620734:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778957.620792:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+22:2345:x1877767510654592:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 192us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778957.620801:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00010000:00010000:3.0:1790778957.621588:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc876326560757df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf4c expref: 21 pid: 5949 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.621607:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531608704:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778957.621628:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621637:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621643:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621684:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621692:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621699:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621705:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.621710:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621717:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621727:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:3.0:1790778957.621739:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790778957.621743:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.621749:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.621810:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+20:11509:x1877767510654336:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 8145us (10506us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790778957.621819:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:0.0:1790778957.625744:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778957.625869:0:6935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510654720 00000100:00100000:1.0:1790778957.625887:0:6935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510654720 00000100:00100000:1.0:1790778957.626007:0:6935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:1.0:1790778957.626018:0:6935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+8:2344:x1877767510654720:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790778957.626079:0:6935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.626116:0:6935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 8 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.626126:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790778957.626131:0:6935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790778957.626136:0:6935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.626178:0:6935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 8 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.626197:0:6935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 8 pid: 6937 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.626228:0:6935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6935:1877767531608832:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778957.626332:0:6935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef233369300 going to sleep for 11 seconds 00000100:00100000:3.0:1790778957.630328:0:6935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6935:1877767531608832:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778957.630370:0:6935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.630809:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.631439:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510654848 00000100:00100000:3.0:1790778957.631472:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510654848 00010000:00010000:3.0:1790778957.631539:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 9 pid: 6937 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.631589:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1790778957.631599:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240df5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+9:2345:x1877767510654848:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778957.631619:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778957.631648:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 9 pid: 6937 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631662:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 9 pid: 6937 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631711:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034afc530/0xdc87632656075809 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf68 expref: 9 pid: 6937 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631731:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790778957.631736:0:5935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790778957.631742:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631754:0:5935:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631784:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778957.631851:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240df5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510654848:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 253us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.631859:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00010000:00010000:3.0:1790778957.631940:0:6935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631950:0:6935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631974:0:6935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631984:0:6935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.631999:0:6935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.632007:0:6935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790778957.632011:0:6935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.632019:0:6935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.632044:0:6935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.632052:0:6935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7bf1016/0xdc8763265607582c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.632103:0:6935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b53b344e-0d4c-4209-a606-d24036760c61+7:2344:x1877767510654720:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 6088us (6372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.632112:0:6935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:1.0:1790778957.636064:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.636157:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510655104 00000100:00100000:2.0:1790778957.636172:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510655104 00000100:00100000:2.0:1790778957.636249:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:2.0:1790778957.636260:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+20:11509:x1877767510655104:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790778957.636358:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.636376:0:12797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 20 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.636387:0:12797:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.636427:0:12797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 20 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.636527:0:12797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 20 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.636551:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531608960:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790778957.636743:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778957.639326:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531608960:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778957.639378:0:12797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.641319:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.641604:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510655232 00000100:00100000:0.0:1790778957.641616:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510655232 00010000:00010000:0.0:1790778957.641655:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 21 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.641699:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:0.0:1790778957.641708:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+21:2345:x1877767510655232:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778957.641723:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778957.641730:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 21 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641744:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 21 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641769:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4e00/0xdc87632656075722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf14 expref: 21 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641788:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.641794:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 20 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641824:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641832:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641841:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.641870:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778957.641948:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+20:2345:x1877767510655232:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 240us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.641956:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00010000:00010000:1.0:1790778957.642633:0:12797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.642643:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.642889:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.642902:0:12797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 20 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.642910:0:12797:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.642943:0:12797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 20 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.642957:0:12797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 20 pid: 7119 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790778957.642972:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b75880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531609088:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790778957.643052:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006600 going to sleep for 11 seconds 00000100:00100000:1.0:1790778957.649577:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.649661:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510655360 00000100:00100000:3.0:1790778957.649673:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510655360 00010000:00010000:3.0:1790778957.649717:0:5935:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 21 pid: 7119 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.649753:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:3.0:1790778957.649780:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+21:2345:x1877767510655360:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778957.649797:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778957.649804:0:5935:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 21 pid: 7119 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.649815:0:5935:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 21 pid: 7119 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.649838:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:3.0:1790778957.649843:0:5935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.649852:0:5935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.649859:0:5935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.649886:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778957.649944:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+21:2345:x1877767510655360:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 166us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.649951:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00010000:00010000:2.0:1790778957.650216:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560757ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf53 expref: 20 pid: 7119 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778957.650234:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b75880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531609088:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790778957.650260:0:12797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.650270:0:12797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.650276:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790778957.650406:0:12797:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1790778957.650597:0:12797:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1790778957.650633:0:12797:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790778957.650717:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12797:1877767531609216:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790778957.650779:0:12797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778957.650809:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790778957.650946:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531609216 00000100:00100000:0.0:1790778957.650954:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531609216 00000100:00100000:0.0:1790778957.651009:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790778957.651017:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12797:x1877767531609216:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1790778957.651111:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12797:x1877767531609216:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.651118:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790778957.651319:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12797:1877767531609216:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1790778957.651435:0:12797:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1790778957.651520:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12797:1877767531609344:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790778957.651549:0:12797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778957.651562:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2365fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1790778957.652572:0:5955:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531609344 00000100:00100000:0.0:1790778957.652584:0:5955:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531609344 00000100:00100000:0.0:1790778957.652630:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790778957.652640:0:5955:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12797:x1877767531609344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1790778957.652804:0:5955:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12797:x1877767531609344:12345-0@lo:1000:mdt00_004.0 Request processed in 166us (1254us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790778957.652812:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790778957.653178:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12797:1877767531609344:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1790778957.653241:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653254:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653274:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653280:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.653285:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653293:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653309:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363a9500) 00010000:00010000:3.0:1790778957.653312:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790778957.653318:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653324:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165b800/0xdc8763265607583a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653362:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653370:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653376:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653382:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.653385:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653401:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653410:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778957.653413:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790778957.653421:0:12797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653433:0:12797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653494:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.653533:0:12797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 23 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.653550:0:12797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531609472:192.168.202.2@tcp:105: 00000100:00100000:3.0:1790778957.653640:0:12797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905540 going to sleep for 11 seconds 00000100:00100000:3.0:1790778957.657092:0:12797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12797:1877767531609472:192.168.202.2@tcp:105: 00010000:00010000:3.0:1790778957.657144:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657156:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef20165a600/0xdc8763265607577d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657200:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657239:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657252:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657265:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657272:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657278:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657283:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.657288:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657296:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657308:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778957.657311:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778957.657315:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657321:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc87632656075841 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657332:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657345:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657351:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657356:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.657359:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657365:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657373:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778957.657375:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790778957.657378:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.657384:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4000/0xdc87632656075833 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.657649:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+23:11509:x1877767510655104:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 21389us (21593us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1790778957.657660:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 235 00000020:00080000:3.0:1790778957.657668:0:12797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790778957.657860:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778957.657871:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778957.658351:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790778957.658362:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778957.662307:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778957.663285:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510655616 00000100:00100000:2.0:1790778957.663301:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510655616 00000100:00100000:2.0:1790778957.663382:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1790778957.663394:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+23:11509:x1877767510655616:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790778957.663773:0:5953:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790778957.663819:0:5953:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1790778957.664925:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.664955:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.664968:0:5953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.664979:0:5953:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.664987:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.664994:0:5953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778957.665021:0:5953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790778957.665159:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+25:11509:x1877767510655616:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1761us (2857us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790778957.665172:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000020:00080000:2.0:1790778957.665197:0:5953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790778957.665846:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778957.665854:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.665862:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790778957.665867:0:5937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.665883:0:5937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.665897:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef2363aa300) 00010000:00010000:1.0:1790778957.665900:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790778957.665905:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.665912:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc87632656075848 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778957.665935:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778957.665937:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778957.665939:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778957.666761:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.667473:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510655744 00000100:00100000:3.0:1790778957.667495:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510655744 00000100:00100000:3.0:1790778957.667553:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:3.0:1790778957.667565:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+25:11508:x1877767510655744:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:3.0:1790778957.667710:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+25:11508:x1877767510655744:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 147us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.667718:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:1.0:1790778957.672504:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.675469:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510656000 00000100:00100000:3.0:1790778957.675494:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510656000 00000100:00100000:3.0:1790778957.675566:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:3.0:1790778957.675577:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+25:11508:x1877767510656000:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:3.0:1790778957.675751:0:7119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1790778957.676006:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+25:11508:x1877767510656000:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 430us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.676014:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:0.0:1790778957.703140:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.703231:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510656128 00000100:00100000:3.0:1790778957.703242:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510656128 00000100:00100000:3.0:1790778957.703307:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:3.0:1790778957.703319:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+25:11511:x1877767510656128:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790778957.703345:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778957.703373:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607584f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf6f expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703522:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703539:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703551:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703589:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703596:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703602:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703686:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703696:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 26 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703705:0:5949:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703737:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 26 pid: 12797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.703751:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 26 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778957.703766:0:5949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531609600:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790778957.704130:0:5949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236905000 going to sleep for 11 seconds 00000100:00100000:3.0:1790778957.706421:0:5949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5949:1877767531609600:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790778957.706505:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.709816:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778957.709898:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510656384 00000100:00100000:3.0:1790778957.709906:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510656384 00000100:00100000:3.0:1790778957.709956:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:3.0:1790778957.709963:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+27:5435:x1877767510656384:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790778957.710198:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:5435:x1877767510656384:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 234us (390us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1790778957.710206:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1790778957.713382:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778957.713498:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510656512 00000100:00100000:0.0:1790778957.713512:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510656512 00010000:00010000:0.0:1790778957.713562:0:12059:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 28 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790778957.713614:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1790778957.713625:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:2345:x1877767510656512:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778957.713644:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778957.713652:0:12059:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 28 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.713665:0:12059:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 28 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.713690:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0400/0xdc8763265607576f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf30 expref: 28 pid: 12797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.713712:0:12059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:0.0:1790778957.713718:0:12059:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.713731:0:12059:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.713739:0:12059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778957.713795:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778957.713865:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53b344e-0d4c-4209-a606-d24036760c61+27:2345:x1877767510656512:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 241us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778957.713879:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00010000:00010000:3.0:1790778957.714193:0:5949:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714204:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778957.714273:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790778957.714279:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778957.714302:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714317:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714327:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714333:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714340:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714358:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aac00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.714362:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714371:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714380:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:3.0:1790778957.714383:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778957.714387:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714394:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aac00/0xdc87632656075856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714409:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714415:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714421:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714425:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778957.714428:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714434:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714510:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef227ba9700) 00010000:00010000:3.0:1790778957.714513:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790778957.714517:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714522:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc8763265607585d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714562:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607584f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf6f expref: 27 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714577:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf6f expref: 26 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778957.714584:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778957.714586:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790778957.714589:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa600, rc 0) 00000100:00100000:3.0:1790778957.714620:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+26:11511:x1877767510656128:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 11303us (11491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778957.714627:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:2.0:1790778957.842158:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531609856:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842249:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778957.842328:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790778957.842336:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531609728:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842370:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778957.842406:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531609984:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842433:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778957.842477:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790778957.842493:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531610112:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842517:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778957.842550:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531609856 00000100:00100000:2.0:1790778957.842559:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531609856 00000100:00100000:2.0:1790778957.842606:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531609984 00000100:00100000:2.0:1790778957.842610:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531609984 00000100:00100000:2.0:1790778957.842643:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531610112 00000100:00100000:2.0:1790778957.842645:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531610112 00000100:00100000:2.0:1790778957.842665:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790778957.842674:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531609856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842732:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531609856:12345-0@lo:400:kworker.0 Request processed in 58us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.842739:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790778957.842761:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790778957.842767:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531609984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842800:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531609984:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.842821:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790778957.842833:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790778957.842839:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842867:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531610112:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.842872:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790778957.842917:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531609856:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842945:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531610112:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.842953:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531609984:0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.843008:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531609728 00000100:00100000:2.0:1790778957.843012:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531609728 00000100:00100000:2.0:1790778957.843037:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1790778957.843043:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531609728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778957.843080:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531609728:12345-0@lo:400:kworker.0 Request processed in 37us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778957.843086:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1790778957.843122:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531609728:0@lo:400:kworker.0 00000100:00080000:2.0:1790778957.843143:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1790778958.224226:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1790778958.224250:0:8008:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1790778958.604886:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790778958.668778:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790778958.668795:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790778958.668833:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790778958.668847:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790778958.669169:0:12077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ad180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531610240:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790778958.669313:0:12077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef211068b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790778958.672796:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778958.672845:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510656640 00000100:00100000:2.0:1790778958.672857:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510656640 00000100:00100000:2.0:1790778958.672993:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:2.0:1790778958.673005:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:11522:x1877767510656640:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790778958.673393:0:5950:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790778958.673594:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b53b344e-0d4c-4209-a606-d24036760c61+27:11522:x1877767510656640:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 589us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778958.673603:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:2.0:1790778958.673675:0:12077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ad180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12077:1877767531610240:192.168.202.2@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1790778958.678844:0:12887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778958.678855:0:12887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778958.678887:0:12887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790778958.678896:0:12887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790778958.679804:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778958.680066:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510656896 00000100:00100000:2.0:1790778958.680188:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510656896 00000100:00100000:2.0:1790778958.680261:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:2.0:1790778958.680272:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+26:11522:x1877767510656896:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790778958.680297:0:7119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778958.680322:0:7119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc8763265607586b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf76 expref: -99 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.680589:0:7119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.680607:0:7119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.680621:0:7119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778958.680644:0:7119:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790778958.680857:0:7119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5e00/0xdc8763265607586b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf76 expref: 29 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.680947:0:7119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf76 expref: 28 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.680957:0:7119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778958.680960:0:7119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790778958.681034:0:7119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4a00, rc 0) 00000100:00100000:2.0:1790778958.681243:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+28:11522:x1877767510656896:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 972us (1446us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790778958.681253:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:1.0:1790778958.686365:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778958.686479:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510657152 00000100:00100000:2.0:1790778958.686497:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510657152 00000100:00100000:2.0:1790778958.686584:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 240 00000100:00100000:2.0:1790778958.686595:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:11522:x1877767510657152:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790778958.686725:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.686748:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.686764:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687428:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687486:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687494:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687500:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790778958.687507:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687516:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687530:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778958.687533:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790778958.687540:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778958.687546:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075880 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778958.687877:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+29:11522:x1877767510657152:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 1280us (1520us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1790778958.687889:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 240 00000040:00080000:0.0:1790778958.689091:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778958.689103:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778958.689621:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790778958.689637:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790778958.696135:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778958.696253:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778958.696288:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510657280 00000100:00100000:3.0:1790778958.696312:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510657280 00000100:00100000:3.0:1790778958.696437:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1790778958.696479:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+29:2345:x1877767510657280:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778958.696501:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778958.696557:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4a00/0xdc87632656075872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf76 expref: 29 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778958.696580:0:5935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778958.696585:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778958.696668:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53b344e-0d4c-4209-a606-d24036760c61+28:2345:x1877767510657280:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 200us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778958.696676:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1790778958.697021:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510657536 00000100:00100000:3.0:1790778958.697026:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510657536 00000100:00100000:3.0:1790778958.697118:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1790778958.697127:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+28:11522:x1877767510657536:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790778958.697407:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+29:11522:x1877767510657536:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 280us (1153us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1790778958.697415:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00010000:00010000:3.0:1790778959.632205:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790778959.692028:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778959.692044:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778959.692071:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790778959.692086:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778959.883666:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531610368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778959.883770:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778959.884226:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531610368 00000100:00100000:1.0:1790778959.884238:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531610368 00000100:00100000:1.0:1790778959.884316:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778959.884328:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531610368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778959.884478:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1790778959.884550:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531610368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 225us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778959.884558:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790778959.884616:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531610368:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790778959.884715:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778959.885475:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531610496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778959.885530:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778959.885671:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531610496 00000100:00100000:0.0:1790778959.885680:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531610496 00000100:00100000:0.0:1790778959.885739:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790778959.885750:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531610496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778959.885778:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42353216 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778959.885825:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531610496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778959.885833:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1790778959.886173:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778959.889437:0:3440:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790778959.889500:0:3440:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1790778959.889544:0:3440:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef2369b9880, transno 4294967307 00000004:00080000:1.0:1790778959.889565:0:3440:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1790778959.889580:0:3440:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236b77800, transno 4294967310 00000100:00100000:1.0:1790778959.889607:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531610496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790778960.658881:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790778960.743357:0:12938:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790778960.743372:0:12938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790778960.743408:0:12938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790778960.743419:0:12938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790778960.947644:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778960.947730:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510657792 00000100:00100000:2.0:1790778960.947745:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510657792 00000100:00100000:2.0:1790778960.947829:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 241 00000100:00100000:2.0:1790778960.947839:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+29:11543:x1877767510657792:12345-192.168.202.2@tcp:101:lfs.0 00000100:00080000:0.0:1790778960.947956:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790778960.948028:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778960.948060:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf7d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.948280:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607588e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.948303:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.948317:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790778960.948331:0:5951:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790778960.949056:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5600/0xdc87632656075887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf7d expref: 32 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.949536:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607588e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf7d expref: 31 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778960.949548:0:5951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:2.0:1790778960.949551:0:5951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790778960.949556:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4c00, rc 0) 00000100:00100000:2.0:1790778960.949686:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b53b344e-0d4c-4209-a606-d24036760c61+31:11543:x1877767510657792:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1847us (2048us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1790778960.949697:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 241 00000100:00100000:1.0:1790778960.980311:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778960.980415:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510657920 00000100:00100000:3.0:1790778960.980427:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510657920 00000100:00100000:3.0:1790778960.980517:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 242 00000100:00100000:3.0:1790778960.980538:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+31:11543:x1877767510657920:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1790778960.980615:0:12797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980631:0:12797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980643:0:12797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980678:0:12797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980685:0:12797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980691:0:12797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980698:0:12797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790778960.980703:0:12797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980710:0:12797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980721:0:12797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:3.0:1790778960.980725:0:12797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790778960.980730:0:12797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778960.980736:0:12797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc8763265607589c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790778960.980814:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+31:11543:x1877767510657920:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 277us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778960.980821:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 242 00000100:00100000:0.0:1790778961.135161:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778961.135234:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658048 00000100:00100000:2.0:1790778961.135244:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658048 00000100:00100000:2.0:1790778961.135406:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:2.0:1790778961.135417:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+7:2343:x1877767510658048:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1790778961.135508:0:6937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790778961.135538:0:6937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bee6646/0xdc876326560758a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf84 expref: -99 pid: 6937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790778961.135567:0:6937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abd1e4d, atime: 0x6abd1e4c, ctime: 0x6abd1e4d, blocks: 0x8 00010000:00010000:2.0:1790778961.135589:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1790778961.135594:0:6937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790778961.135607:0:6937:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bee6646/0xdc876326560758a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf84 expref: 8 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778961.135629:0:6937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bee6646/0xdc876326560758a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf84 expref: 8 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778961.135644:0:6937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4000, rc 0) 00000100:00100000:2.0:1790778961.135709:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b53b344e-0d4c-4209-a606-d24036760c61+8:2343:x1877767510658048:12345-192.168.202.2@tcp:101:cat.0 Request processed in 294us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778961.135717:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00080000:3.0:1790778961.136327:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778961.141005:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778961.141249:0:6940:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658176 00000100:00100000:1.0:1790778961.141260:0:6940:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658176 00002000:00100000:1.0:1790778961.141313:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ef2364e2300 x1877767510658176/t0(0) o3->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:512/0 lens 488/0 e 0 to 0 dl 1790778972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778961.141324:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2364e2300 with x1877767510658176 ext(0->4095) 00002000:00010000:1.0:1790778961.141329:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2364e2300 00000100:00100000:1.0:1790778961.141563:0:6940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1790778961.141578:0:6940:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510658176:12345-192.168.202.2@tcp:3:cat.0 00000100:00100000:1.0:1790778961.141754:0:6940:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510658176:12345-192.168.202.2@tcp:3:cat.0 Request processed in 179us (758us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790778961.141762:0:6940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00002000:00100000:1.0:1790778961.141770:0:6940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ef2364e2300 x1877767510658176/t0(0) o3->b53b344e-0d4c-4209-a606-d24036760c61@192.168.202.2@tcp:512/0 lens 488/4536 e 0 to 0 dl 1790778972 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790778961.141796:0:6940:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef2364e2300 with x1877767510658176 ext(0->4095) 00002000:00010000:1.0:1790778961.141800:0:6940:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ef2364e2300 00010000:00010000:2.0:1790778961.677110:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778961.749137:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778961.749183:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778961.749398:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778961.749426:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778961.749522:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658432 00000100:00100000:2.0:1790778961.749535:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658432 00000100:00100000:2.0:1790778961.749604:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:2.0:1790778961.749617:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:2345:x1877767510658432:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778961.749662:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658304 00000100:00100000:3.0:1790778961.749687:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658304 00000100:00100000:2.0:1790778961.749718:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+31:2345:x1877767510658432:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 101us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778961.749729:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:3.0:1790778961.749770:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 299 00000100:00100000:3.0:1790778961.749785:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510658304:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778961.749869:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef220190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510658304:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 88us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778961.749878:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 299 00000100:00100000:0.0:1790778961.756987:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778961.757184:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658816 00000100:00100000:2.0:1790778961.757225:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658816 00000100:00100000:2.0:1790778961.757316:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:2.0:1790778961.757327:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510658816:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778961.757426:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2345:x1877767510658816:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 101us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778961.757435:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00080000:0.0:1790778961.757713:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778961.759500:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658688 00000100:00100000:1.0:1790778961.760221:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658688 00000100:00080000:0.0:1790778961.760329:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790778961.760348:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658560 00000100:00100000:1.0:1790778961.760355:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658560 00000100:00100000:1.0:1790778961.760398:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:1.0:1790778961.760410:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510658688:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778961.760438:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1790778961.760498:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510658560:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778961.760652:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+8:2345:x1877767510658560:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 165us (11223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778961.760662:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1790778961.760847:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510658688:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 437us (11660us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778961.760857:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00010000:00010000:3.0:1790778962.703469:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778962.962829:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531610880:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.962913:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.962975:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790778962.962982:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531611008:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.963009:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778962.963058:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531610880 00000100:00100000:3.0:1790778962.963066:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531610880 00000100:00100000:3.0:1790778962.963119:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790778962.963139:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531610880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.963195:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531610880:12345-0@lo:400:kworker.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.963203:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790778962.963234:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611008 00000100:00100000:3.0:1790778962.963238:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611008 00000100:00100000:3.0:1790778962.963265:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790778962.963273:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531611008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.963305:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531611008:12345-0@lo:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.963311:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1790778962.963327:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790778962.963331:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778962.963366:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531611008:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.963377:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531610880:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966113:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2364e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531610624:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966207:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.966271:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531611136:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966301:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.966331:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790778962.966339:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531610752:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966361:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.966381:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef206d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531611264:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966406:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778962.966467:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611136 00000100:00100000:1.0:1790778962.966476:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611136 00000100:00100000:1.0:1790778962.966530:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531610752 00000100:00100000:1.0:1790778962.966533:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531610752 00000100:00100000:1.0:1790778962.966554:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790778962.966577:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531611136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966637:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531611136:12345-0@lo:400:kworker.0 Request processed in 62us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.966644:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790778962.966662:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790778962.966668:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531610752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966695:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531610752:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.966701:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790778962.966717:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611264 00000100:00100000:1.0:1790778962.966721:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611264 00000100:00100000:1.0:1790778962.966746:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790778962.966752:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531611264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966780:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531611264:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778962.966786:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1790778962.966804:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778962.966808:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778962.966837:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531610752:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966847:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531611264:0@lo:400:kworker.0 00000100:00100000:1.0:1790778962.966856:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef206d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531611136:0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.967839:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531610624 00000100:00100000:3.0:1790778962.967851:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531610624 00000100:00100000:3.0:1790778962.967918:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1790778962.967927:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531610624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778962.967997:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef215070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531610624:12345-0@lo:400:kworker.0 Request processed in 70us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778962.968004:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1790778962.968059:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2364e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531610624:0@lo:400:kworker.0 00000001:00080000:1.0:1790778962.972705:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1790778962.972733:0:6930:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1790778962.980602:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790778962.980649:0:5927:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef2365fcf00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790778962.980656:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef205a4b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef2365fcc00 00000020:00080000:3.0:1790778962.980660:0:5927:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef205a4b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef235c6c000 00000020:00080000:3.0:1790778962.980718:0:5927:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1790778962.980947:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1790778962.981164:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1790778963.723867:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778964.747778:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778965.006001:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531611392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778965.006105:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778965.006493:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611392 00000100:00100000:3.0:1790778965.006504:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611392 00000100:00100000:3.0:1790778965.006578:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790778965.006591:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531611392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790778965.006636:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:3.0:1790778965.006697:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531611392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778965.006705:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790778965.006946:0:3439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1790778965.006954:0:3439:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236b7d180, transno 4294967323 00000004:00080000:3.0:1790778965.006966:0:3439:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1790778965.007002:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531611392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790778965.007816:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790778965.011138:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531611520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790778965.011254:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778965.011500:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611520 00000100:00100000:1.0:1790778965.011512:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611520 00000100:00100000:1.0:1790778965.011606:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790778965.011619:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531611520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790778965.011663:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42353216 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790778965.011804:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531611520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778965.011814:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790778965.011889:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531611520:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790778965.012169:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790778965.771658:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778966.770832:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778966.771019:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510658944 00000100:00100000:3.0:1790778966.771034:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510658944 00000100:00100000:3.0:1790778966.771142:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 243 00000100:00100000:3.0:1790778966.771157:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+18:11196:x1877767510658944:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790778966.771318:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b53b344e-0d4c-4209-a606-d24036760c61+18:11196:x1877767510658944:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 165us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778966.771326:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 243 00000100:00080000:2.0:1790778966.772495:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790778966.773323:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778966.773413:0:5952:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659200 00000100:00100000:1.0:1790778966.773426:0:5952:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659200 00000100:00100000:1.0:1790778966.773506:0:5952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:1.0:1790778966.773518:0:5952:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+18:11196:x1877767510659200:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790778966.773866:0:5952:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b53b344e-0d4c-4209-a606-d24036760c61+19:11196:x1877767510659200:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 348us (560us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790778966.773875:0:5952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00010000:00010000:3.0:1790778966.795764:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778966.865280:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778966.865842:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778966.865875:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778966.865920:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778966.865990:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659712 00000100:00100000:1.0:1790778966.866004:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659712 00000100:00100000:1.0:1790778966.866091:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:1.0:1790778966.866103:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510659712:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778966.866200:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4dac8e38-11f9-42ba-9bac-432079f13049+5:2346:x1877767510659712:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778966.866208:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00080000:1.0:1790778966.866622:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778966.866714:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659328 00000100:00100000:2.0:1790778966.866720:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659328 00000100:00100000:2.0:1790778966.866771:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 301 00000100:00100000:2.0:1790778966.866779:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510659328:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1790778966.866835:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2346:x1877767510659328:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 57us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778966.866842:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 301 00000100:00100000:3.0:1790778966.872605:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659456 00000100:00100000:3.0:1790778966.872630:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659456 00000100:00100000:3.0:1790778966.873195:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659584 00000100:00100000:3.0:1790778966.873217:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659584 00000100:00100000:3.0:1790778966.873257:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1790778966.873269:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510659456:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778966.873515:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1790778966.873528:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510659584:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778966.873636:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2346:x1877767510659584:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 111us (7713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778966.873645:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:3.0:1790778966.874033:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2346:x1877767510659456:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 764us (8768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778966.874042:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00080000:1.0:1790778966.874106:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778966.874121:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790778967.821181:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778968.082481:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531611904:0@lo:400:kworker.0 00000100:00100000:0.0:1790778968.082591:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778968.082679:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778968.082686:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531612032:0@lo:400:kworker.0 00000100:00100000:0.0:1790778968.082715:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778968.082900:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531611648:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.082939:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778968.082967:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531612160:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.082987:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778968.083016:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790778968.083021:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531611776:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083042:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778968.083058:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531612288:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083077:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778968.083106:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611648 00000100:00100000:3.0:1790778968.083116:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611648 00000100:00100000:3.0:1790778968.083166:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1790778968.083177:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531611648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083234:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531611648:12345-0@lo:400:kworker.0 Request processed in 58us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778968.083242:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1790778968.083278:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611904 00000100:00100000:3.0:1790778968.083282:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611904 00000100:00100000:3.0:1790778968.083318:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612160 00000100:00100000:3.0:1790778968.083321:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612160 00000100:00100000:3.0:1790778968.083353:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531611776 00000100:00100000:3.0:1790778968.083357:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531611776 00000100:00100000:3.0:1790778968.083372:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790778968.083378:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531611904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083433:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531611904:12345-0@lo:400:kworker.0 Request processed in 54us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778968.083439:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790778968.083475:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790778968.083486:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531612160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083518:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531612160:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778968.083523:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790778968.083534:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790778968.083540:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef206d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531611776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083567:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef206d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531611776:12345-0@lo:400:kworker.0 Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778968.083573:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790778968.083594:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612032 00000100:00100000:3.0:1790778968.083598:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612032 00000100:00100000:3.0:1790778968.083628:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612288 00000100:00100000:3.0:1790778968.083630:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612288 00000100:00100000:3.0:1790778968.083649:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790778968.083656:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531612032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083685:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531612032:12345-0@lo:400:kworker.0 Request processed in 31us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778968.083691:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790778968.083700:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790778968.083712:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2364e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531612288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083754:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2364e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531612288:12345-0@lo:400:kworker.0 Request processed in 42us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778968.083759:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790778968.083814:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531611776:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083825:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531612288:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083833:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531611648:0@lo:400:kworker.0 00000100:00100000:3.0:1790778968.083842:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531612160:0@lo:400:kworker.0 00000100:00100000:0.0:1790778968.084330:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531612032:0@lo:400:kworker.0 00000100:00100000:0.0:1790778968.084343:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531611904:0@lo:400:kworker.0 00000100:00080000:0.0:1790778968.084408:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790778968.084413:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790778968.084417:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790778968.842123:0:13135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:36:07 (1790778967) 00010000:00010000:3.0:1790778968.845226:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790778969.120830:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1790778969.120876:0:5927:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790778969.121215:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790778969.121230:0:5981:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790778969.867921:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790778969.931715:0:12077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790778969.931726:0:12077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790778969.931854:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790778969.931865:0:12077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790778970.124209:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778970.124239:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790778970.124330:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778970.124556:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612416 00000100:00100000:1.0:1790778970.124569:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612416 00000100:00100000:1.0:1790778970.124644:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790778970.124656:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531612416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790778970.124692:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1790778970.124761:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531612416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778970.124769:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790778970.124838:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790778970.125040:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778970.125052:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531612544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790778970.125084:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778970.125113:0:6938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612544 00000100:00100000:0.0:1790778970.125117:0:6938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612544 00000100:00100000:0.0:1790778970.125144:0:6938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790778970.125152:0:6938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531612544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778970.125170:0:6938:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42353216 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778970.125204:0:6938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531612544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778970.125211:0:6938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790778970.125242:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531612544:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790778970.125388:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790778970.125393:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790778970.892714:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778971.184496:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778971.184963:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659840 00000100:00100000:3.0:1790778971.184974:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659840 00000100:00100000:3.0:1790778971.185066:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 244 00000100:00100000:3.0:1790778971.185078:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+5:12208:x1877767510659840:12345-192.168.202.2@tcp:101:lsof.0 00010000:00010000:3.0:1790778971.185103:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790778971.185127:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc876326560758aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcf8b expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778971.185199:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560758b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778971.185227:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560758b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778971.185242:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560758b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790778971.185291:0:5949:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790778971.185296:0:5949:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790778971.185344:0:5949:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560758b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778971.185384:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aae00/0xdc876326560758aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf8b expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778971.185408:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560758b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf8b expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790778971.185409:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790778971.185422:0:5949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:3.0:1790778971.185426:0:5949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790778971.185430:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:3.0:1790778971.185543:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4dac8e38-11f9-42ba-9bac-432079f13049+6:12208:x1877767510659840:12345-192.168.202.2@tcp:101:lsof.0 Request processed in 468us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778971.185552:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 244 00010000:00010000:3.0:1790778971.916671:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778971.988984:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778971.989056:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778971.989086:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778971.989119:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778971.989145:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790778971.989171:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510660480 00000100:00100000:0.0:1790778971.989180:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510660480 00000100:00100000:0.0:1790778971.989228:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510660096 00000100:00100000:0.0:1790778971.989232:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510660096 00000100:00100000:0.0:1790778971.989260:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:0.0:1790778971.989271:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+6:2345:x1877767510660480:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778971.989373:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+6:2345:x1877767510660480:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778971.989381:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:0.0:1790778971.989400:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:0.0:1790778971.989407:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:2345:x1877767510660096:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790778971.989481:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b53b344e-0d4c-4209-a606-d24036760c61+18:2345:x1877767510660096:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 34us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778971.989488:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00080000:0.0:1790778971.989507:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778971.989665:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510659968 00000100:00100000:1.0:1790778971.989670:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510659968 00000100:00100000:1.0:1790778971.989699:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 303 00000100:00100000:1.0:1790778971.989705:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510659968:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790778971.989732:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2345:x1877767510659968:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778971.989750:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 303 00000100:00100000:3.0:1790778971.990684:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510660224 00000100:00100000:3.0:1790778971.990693:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510660224 00000100:00100000:3.0:1790778971.990763:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510660352 00000100:00100000:3.0:1790778971.990768:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510660352 00000100:00100000:3.0:1790778971.990793:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:3.0:1790778971.990814:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510660224:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778971.990866:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+7:2345:x1877767510660224:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 53us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778971.990873:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:3.0:1790778971.990887:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:3.0:1790778971.990894:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510660352:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790778971.990919:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+5:2345:x1877767510660352:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778971.990926:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00080000:1.0:1790778971.994236:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790778971.994247:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790778972.940903:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778973.198896:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531612928:0@lo:400:kworker.0 00000100:00100000:1.0:1790778973.198969:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778973.199062:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778973.199068:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531613056:0@lo:400:kworker.0 00000100:00100000:1.0:1790778973.199099:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778973.199133:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613056 00000100:00100000:1.0:1790778973.199140:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613056 00000100:00100000:1.0:1790778973.199190:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790778973.199199:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531613056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778973.199254:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531613056:12345-0@lo:400:kworker.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778973.199260:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1790778973.199283:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778973.199313:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531613056:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199407:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2366caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531612800:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199439:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778973.199503:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531613312:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199524:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778973.199543:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790778973.199548:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531612672:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199585:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778973.199612:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531613184:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199633:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778973.199658:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612672 00000100:00100000:2.0:1790778973.199663:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612672 00000100:00100000:2.0:1790778973.199695:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790778973.199702:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531612672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199737:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+19:3442:x1877767531612672:12345-0@lo:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778973.199743:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790778973.199769:0:6937:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613312 00000100:00100000:2.0:1790778973.199772:0:6937:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613312 00000100:00100000:2.0:1790778973.199800:0:6937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790778973.199808:0:6937:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531613312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199837:0:6937:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531613312:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778973.199843:0:6937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1790778973.199869:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778973.199887:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531612672:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.199897:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531613312:0@lo:400:kworker.0 00000100:00100000:3.0:1790778973.199976:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612928 00000100:00100000:3.0:1790778973.199982:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612928 00000100:00100000:3.0:1790778973.200023:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531612800 00000100:00100000:3.0:1790778973.200026:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531612800 00000100:00100000:3.0:1790778973.200039:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613184 00000100:00100000:3.0:1790778973.200042:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613184 00000100:00100000:3.0:1790778973.200054:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790778973.200060:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531612928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778973.200116:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531612928:12345-0@lo:400:kworker.0 Request processed in 55us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778973.200122:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790778973.200134:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790778973.200140:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531612800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778973.200169:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531612800:12345-0@lo:400:kworker.0 Request processed in 29us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778973.200175:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790778973.200185:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790778973.200197:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531613184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778973.200230:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1877767531613184:12345-0@lo:400:kworker.0 Request processed in 33us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778973.200236:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790778973.200322:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531612928:0@lo:400:kworker.0 00000100:00080000:2.0:1790778973.200464:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790778973.200482:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531613184:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.200493:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2366caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531612800:0@lo:400:kworker.0 00000100:00100000:2.0:1790778973.392947:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.393079:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510660736 00000100:00100000:3.0:1790778973.393090:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510660736 00000100:00100000:3.0:1790778973.393169:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:3.0:1790778973.393180:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+18:12209:x1877767510660736:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:3.0:1790778973.393476:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:12209:x1877767510660736:12345-192.168.202.2@tcp:35:umount.0 Request processed in 297us (537us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790778973.393484:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00080000:2.0:1790778973.393731:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778973.397921:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.398094:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510660992 00000100:00100000:3.0:1790778973.398106:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510660992 00000100:00100000:3.0:1790778973.398163:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:3.0:1790778973.398173:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+19:12209:x1877767510660992:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:3.0:1790778973.398600:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:12209:x1877767510660992:12345-192.168.202.2@tcp:35:umount.0 Request processed in 426us (688us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1790778973.398609:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1790778973.409362:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.410885:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510661248 00000100:00100000:3.0:1790778973.410902:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510661248 00000100:00100000:3.0:1790778973.410971:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:3.0:1790778973.410982:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef208f79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+20:12209:x1877767510661248:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:3.0:1790778973.411238:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef208f79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:12209:x1877767510661248:12345-192.168.202.2@tcp:35:umount.0 Request processed in 256us (1886us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1790778973.411247:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1790778973.427661:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.436229:0:5953:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510661504 00000100:00100000:3.0:1790778973.436247:0:5953:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510661504 00000100:00100000:0.0:1790778973.436487:0:5953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1790778973.436499:0:5953:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+21:12209:x1877767510661504:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:0.0:1790778973.436834:0:5953:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b53b344e-0d4c-4209-a606-d24036760c61+22:12209:x1877767510661504:12345-192.168.202.2@tcp:35:umount.0 Request processed in 335us (9706us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1790778973.436843:0:5953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:1.0:1790778973.450677:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778973.450793:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778973.454580:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778973.454670:0:5934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510661632 00000100:00100000:2.0:1790778973.454681:0:5934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510661632 00000100:00100000:3.0:1790778973.454930:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510661760 00000100:00100000:3.0:1790778973.454936:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510661760 00000100:00100000:3.0:1790778973.454994:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1790778973.455004:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d2500a-b265-416e-aebe-5cbe8594cb7d+14:2343:x1877767510661760:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778973.455020:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778973.455039:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499600/0xdc87632656074849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcabb expref: 14 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778973.455067:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778973.455119:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d2500a-b265-416e-aebe-5cbe8594cb7d+13:2343:x1877767510661760:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 107us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778973.455128:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1790778973.455227:0:5934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1790778973.455236:0:5934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2368f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:2343:x1877767510661632:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790778973.455243:0:5934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778973.455252:0:5934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4ce00/0xdc87632656074881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcaf3 expref: 12 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778973.455262:0:5934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778973.455283:0:5934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2368f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:2343:x1877767510661632:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 47us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778973.455289:0:5934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:1.0:1790778973.455961:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.456033:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510661888 00000100:00100000:3.0:1790778973.456039:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510661888 00000100:00100000:2.0:1790778973.456056:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510662016 00000100:00100000:3.0:1790778973.456077:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1790778973.456087:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240df6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:2346:x1877767510661888:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790778973.456097:0:5935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778973.456108:0:5935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4c200/0xdc87632656074acd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbbe expref: 11 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790778973.456118:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510662016 00010000:00010000:3.0:1790778973.456128:0:5935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778973.456160:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240df6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510661888:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 75us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778973.456167:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1790778973.456195:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:2.0:1790778973.456201:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+5:2342:x1877767510662016:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:2.0:1790778973.456228:0:12307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074bbb 00000100:00080000:2.0:1790778973.456236:0:12307:0:(import.c:65:import_set_state_nolock()) ffff9ef236555000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790778973.456280:0:12307:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1790778973.456419:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b53b344e-0d4c-4209-a606-d24036760c61+2:2342:x1877767510662016:12345-192.168.202.2@tcp:9:umount.0 Request processed in 217us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778973.456426:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00010000:00010000:2.0:1790778973.456533:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790778973.457275:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790778973.483274:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.483411:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510662400 00000100:00100000:3.0:1790778973.483423:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510662400 00000100:00100000:3.0:1790778973.483525:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:3.0:1790778973.483535:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+7:2342:x1877767510662400:12345-192.168.202.2@tcp:9:umount.0 00000100:00080000:1.0:1790778973.483550:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1790778973.483570:0:6934:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074e31 00000020:00010000:3.0:1790778973.483577:0:6934:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ef207d35800: total 0 00000100:00080000:3.0:1790778973.483583:0:6934:0:(import.c:65:import_set_state_nolock()) ffff9ef215c18800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790778973.483643:0:6934:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1790778973.483850:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b53b344e-0d4c-4209-a606-d24036760c61+5:2342:x1877767510662400:12345-192.168.202.2@tcp:9:umount.0 Request processed in 316us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778973.483859:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000020:00010000:2.0:1790778973.484023:0:6950:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ef207d35800: total 0 00010000:00010000:2.0:1790778973.484059:0:6950:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef207d35800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790778973.484118:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bee6646/0xdc876326560758a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf84 expref: 4 pid: 6937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778973.484160:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b781af7f/0xdc876326560751e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcda8 expref: 3 pid: 6934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778973.484176:0:6950:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef207d35800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790778973.484189:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778973.484191:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778973.484192:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778973.508067:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790778973.508161:0:12797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510663424 00000100:00100000:3.0:1790778973.508171:0:12797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510663424 00000100:00100000:3.0:1790778973.508233:0:12797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 245 00000100:00100000:3.0:1790778973.508243:0:12797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+22:2342:x1877767510663424:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:3.0:1790778973.508281:0:12797:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074857 00000020:00010000:3.0:1790778973.508297:0:12797:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ef2358c0800: total 0 00000100:00080000:3.0:1790778973.508301:0:12797:0:(import.c:65:import_set_state_nolock()) ffff9ef235dc0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790778973.508413:0:12797:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1790778973.508621:0:12797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b53b344e-0d4c-4209-a606-d24036760c61+21:2342:x1877767510663424:12345-192.168.202.2@tcp:39:umount.0 Request processed in 378us (564us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1790778973.508630:0:12797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 245 00000020:00010000:1.0:1790778973.510818:0:5937:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ef2358c0800: total 0 00010000:00010000:1.0:1790778973.510907:0:5937:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef2358c0800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790778973.510947:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778973.510952:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790778973.510963:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387400/0xdc87632656075259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdc4 expref: 20 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.510984:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778973.511001:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790778973.511006:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5a00/0xdc87632656074b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbe8 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511022:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef2363a9700) 00010000:00010000:1.0:1790778973.511025:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778973.511029:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656074e8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dccc1 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511051:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:1.0:1790778973.511053:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778973.511057:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa600/0xdc87632656075864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf6f expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511069:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef2363a8c00) 00010000:00010000:1.0:1790778973.511071:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790778973.511074:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4800/0xdc87632656074b3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbd3 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511088:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778973.511091:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790778973.511094:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014aa200/0xdc876326560751aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd93 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511105:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778973.511107:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790778973.511111:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc876326560751d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcda1 expref: 14 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511138:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:1.0:1790778973.511141:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778973.511145:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4600/0xdc8763265607523d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcdbd expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511155:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:1.0:1790778973.511157:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790778973.511161:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4c00/0xdc8763265607588e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf7d expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511172:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef22051ff00) 00010000:00010000:1.0:1790778973.511175:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790778973.511178:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dce9d expref: 11 pid: 7119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511194:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef2363a8b00) 00010000:00010000:1.0:1790778973.511196:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790778973.511200:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4cc00/0xdc87632656074b21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbcc expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511214:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef203c61d00) 00010000:00010000:1.0:1790778973.511216:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790778973.511220:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5200/0xdc87632656075784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf37 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511235:0:5937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef227ba9500) 00010000:00010000:1.0:1790778973.511237:0:5937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790778973.511248:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc876326560750ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcd5b expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778973.511262:0:5937:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef2358c0800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790778973.511277:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778973.511280:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778973.511282:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778973.965132:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778974.987777:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778975.244091:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790778975.244121:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790778975.244203:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778975.244475:0:8834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613440 00000100:00100000:0.0:1790778975.244483:0:8834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613440 00000100:00100000:0.0:1790778975.244558:0:8834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790778975.244569:0:8834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531613440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790778975.244602:0:8834:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790778975.244662:0:8834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531613440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778975.244669:0:8834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1790778975.245761:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778975.245817:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790778975.250169:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778975.250202:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531613568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790778975.250289:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778975.250924:0:6939:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613568 00000100:00100000:2.0:1790778975.250938:0:6939:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613568 00000100:00100000:2.0:1790778975.251022:0:6939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790778975.251032:0:6939:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531613568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790778975.251068:0:6939:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:2.0:1790778975.251136:0:6939:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531613568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778975.251153:0:6939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1790778975.251610:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790778975.251953:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531613568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790778976.014800:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790778976.269394:0:5927:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000001:00080000:3.0:1790778976.269428:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1790778976.269478:0:5927:0:(genops.c:885:class_export_put()) final put ffff9ef2358c0800/b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:2.0:1790778976.279431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2358c0800/b53b344e-0d4c-4209-a606-d24036760c61 for lustre-MDT0000 00000020:00000080:2.0:1790778976.279594:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef235dc0000 for lustre-MDT0000 00000100:00100000:1.0:1790778976.342944:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778976.342999:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778976.343060:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790778976.343196:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510663552 00000100:00100000:2.0:1790778976.343212:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510663552 00000100:00100000:2.0:1790778976.343329:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510663808 00000100:00100000:2.0:1790778976.343334:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510663808 00000100:00100000:2.0:1790778976.343350:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510663680 00000100:00100000:2.0:1790778976.343353:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510663680 00000100:00100000:2.0:1790778976.343384:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1790778976.343397:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+12:2343:x1877767510663552:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778976.343418:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778976.343482:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236387000/0xdc87632656074929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb08 expref: 12 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778976.343507:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778976.343581:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+11:2343:x1877767510663552:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 186us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778976.343590:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1790778976.343611:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1790778976.343633:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+10:2346:x1877767510663808:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778976.343643:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778976.343654:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4c000/0xdc87632656074ac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcbb7 expref: 10 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778976.343664:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778976.343684:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+9:2346:x1877767510663808:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 53us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778976.343691:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1790778976.343704:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1790778976.343710:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+8:2344:x1877767510663680:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790778976.343719:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790778976.343728:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236386200/0xdc87632656074930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcb32 expref: 8 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778976.343738:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790778976.343756:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60d2500a-b265-416e-aebe-5cbe8594cb7d+7:2344:x1877767510663680:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 45us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778976.343761:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1790778976.359220:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778976.359353:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664064 00000100:00100000:1.0:1790778976.359376:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664064 00000100:00100000:1.0:1790778976.359517:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 246 00000100:00100000:1.0:1790778976.359529:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+6:2342:x1877767510664064:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:1.0:1790778976.359589:0:7119:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607493e 00000020:00010000:1.0:1790778976.359599:0:7119:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ef2365bd800: total 0 00000100:00080000:1.0:1790778976.359605:0:7119:0:(import.c:65:import_set_state_nolock()) ffff9ef2365b9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790778976.359641:0:7119:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1790778976.360017:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4dac8e38-11f9-42ba-9bac-432079f13049+5:2342:x1877767510664064:12345-192.168.202.2@tcp:39:umount.0 Request processed in 489us (811us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1790778976.360025:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 246 00000020:00010000:2.0:1790778976.360808:0:5936:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ef2365bd800: total 0 00010000:00010000:2.0:1790778976.360819:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778976.360907:0:5936:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef2365bd800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790778976.360959:0:5936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef2363a9300) 00010000:00010000:2.0:1790778976.360964:0:5936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790778976.360977:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2014ab200/0xdc876326560758b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcf8b expref: 4 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778976.361031:0:5936:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef2365bd800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790778976.361045:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778976.361047:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778976.361049:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790778976.361400:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790778976.389602:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790778976.389722:0:5942:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664320 00000100:00100000:1.0:1790778976.389736:0:5942:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664320 00000100:00100000:1.0:1790778976.389836:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 305 00000100:00100000:1.0:1790778976.389856:0:5942:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+7:2342:x1877767510664320:12345-192.168.202.2@tcp:251:umount.0 00000020:00000080:1.0:1790778976.389922:0:5942:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074834 00000020:00010000:1.0:1790778976.389933:0:5942:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ef235886800: total 0 00000100:00080000:1.0:1790778976.389939:0:5942:0:(import.c:65:import_set_state_nolock()) ffff9ef235882800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790778976.390032:0:5942:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60d2500a-b265-416e-aebe-5cbe8594cb7d+3:2342:x1877767510664320:12345-192.168.202.2@tcp:251:umount.0 Request processed in 178us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778976.390041:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 305 00000020:00010000:0.0:1790778976.390430:0:6950:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ef235886800: total 0 00010000:00010000:0.0:1790778976.390558:0:6950:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef235886800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790778976.390600:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4d800/0xdc87632656074888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcafa expref: 2 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778976.390618:0:6950:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef235886800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790778976.390628:0:6950:0:(genops.c:885:class_export_put()) final put ffff9ef235886800/60d2500a-b265-416e-aebe-5cbe8594cb7d 00010000:00010000:0.0:1790778976.390694:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778976.390697:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778976.390699:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790778976.391603:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235886800/60d2500a-b265-416e-aebe-5cbe8594cb7d for MGS 00000020:00000080:3.0:1790778976.391787:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef235882800 for MGS 00010000:00010000:0.0:1790778977.036652:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778978.061829:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790778978.316807:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531613824:0@lo:400:kworker.0 00000100:00100000:1.0:1790778978.316807:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531613952:0@lo:400:kworker.0 00000100:00100000:3.0:1790778978.316874:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531613696:0@lo:400:kworker.0 00000100:00100000:2.0:1790778978.318358:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778978.320036:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531614336:0@lo:400:kworker.0 00000100:00100000:2.0:1790778978.320111:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790778978.320197:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613824 00000100:00100000:2.0:1790778978.320208:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613824 00000100:00100000:2.0:1790778978.320277:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790778978.320306:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2366caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531613824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778978.320379:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2366caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531613824:12345-0@lo:400:kworker.0 Request processed in 75us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778978.320388:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790778978.320434:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614336 00000100:00100000:2.0:1790778978.320438:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614336 00000100:00100000:2.0:1790778978.320493:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790778978.320500:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531614336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790778978.320533:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531614336:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790778978.320540:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790778978.320581:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531614336:0@lo:400:kworker.0 00000100:00100000:2.0:1790778978.320594:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531613824:0@lo:400:kworker.0 00000100:00100000:1.0:1790778978.320966:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778978.321004:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613952 00000100:00100000:0.0:1790778978.321010:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613952 00000100:00100000:0.0:1790778978.321052:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790778978.321060:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531613952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790778978.321098:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531613952:12345-0@lo:400:kworker.0 Request processed in 39us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778978.321105:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1790778978.321160:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790778978.321165:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790778978.321198:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778978.321290:0:5943:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531613696 00000100:00100000:0.0:1790778978.321294:0:5943:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531613696 00000100:00100000:1.0:1790778978.321302:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531613952:0@lo:400:kworker.0 00000100:00100000:0.0:1790778978.321323:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790778978.321329:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790778978.321329:0:5943:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531613696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778978.321336:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531614080:0@lo:400:kworker.0 00000100:00100000:1.0:1790778978.321361:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778978.321361:0:5943:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:763f742b-0483-425a-8826-84839ee976ad+19:3441:x1877767531613696:12345-0@lo:400:kworker.0 Request processed in 32us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778978.321367:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1790778978.328896:0:6934:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614080 00000100:00100000:3.0:1790778978.328926:0:6934:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614080 00000100:00100000:3.0:1790778978.329212:0:6934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790778978.329225:0:6934:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778978.329407:0:6934:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531614080:12345-0@lo:400:kworker.0 Request processed in 185us (8045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778978.329415:0:6934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790778978.329489:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531614080:0@lo:400:kworker.0 00000100:00080000:2.0:1790778978.329547:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790778978.329606:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531613696:0@lo:400:kworker.0 00000100:00100000:3.0:1790778978.329618:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531614208:0@lo:400:kworker.0 00000100:00100000:3.0:1790778978.329657:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778978.336668:0:5950:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614208 00000100:00100000:1.0:1790778978.336684:0:5950:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614208 00000100:00080000:0.0:1790778978.336739:0:5945:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790778978.336772:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790778978.336783:0:5950:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531614208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790778978.336901:0:5950:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531614208:12345-0@lo:400:kworker.0 Request processed in 120us (7243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778978.336909:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790778978.337609:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531614208:0@lo:400:kworker.0 00000020:01000004:2.0:1790778978.492084:0:13331:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790778978.532897:0:13331:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790778978.532971:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.532989:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.532998:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.533008:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.533041:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790778978.533050:0:13331:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790778978.533080:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790778978.533086:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790778978.533092:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790778978.533121:0:13331:0:(import.c:65:import_set_state_nolock()) ffff9ef20d3d2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790778978.533218:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531614464:0@lo:39:umount.0 00000100:00100000:1.0:1790778978.533312:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790778978.533415:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778978.533422:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778978.533428:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef201498200 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778978.533432:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778978.533602:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778978.533608:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778978.533613:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790778978.533614:0:6950:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790778978.533616:0:6950:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790778978.533641:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778978.533647:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778978.533668:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778978.533676:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef201498200/0xdc876326560748c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748ce expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778978.533705:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778978.533708:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778978.533710:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778978.534135:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531614592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778978.534172:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778978.534369:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614592 00000100:00100000:0.0:1790778978.534377:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614592 00000100:00100000:0.0:1790778978.534427:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790778978.534436:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+19:3439:x1877767531614592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790778978.534473:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790778978.534499:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a0000/0xdc876326560748ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560748c7 expref: 19 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778978.534512:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790778978.534550:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+18:3439:x1877767531614592:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790778978.534558:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790778978.534614:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531614592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778978.534813:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614464 00000100:00100000:3.0:1790778978.534817:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614464 00000100:00100000:3.0:1790778978.534856:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790778978.534864:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3438:x1877767531614464:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790778978.534889:0:5949:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074643 00000100:00080000:3.0:1790778978.534898:0:5949:0:(import.c:65:import_set_state_nolock()) ffff9ef23333f000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790778978.534983:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778978.535166:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3438:x1877767531614464:12345-0@lo:39:umount.0 Request processed in 302us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778978.535173:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000020:00000080:3.0:1790778978.535180:0:5949:0:(genops.c:885:class_export_put()) final put ffff9ef2330b8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790778978.535244:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2330b8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1790778978.535303:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef23333f000 for lustre-MDT0000 00000100:00080000:1.0:1790778978.535386:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef20d3d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790778978.535465:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531614464:0@lo:39:umount.0 00000100:00080000:2.0:1790778978.535614:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790778978.535618:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790778978.535623:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790778978.536584:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536600:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536622:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536629:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536704:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790778978.536711:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536719:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536725:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.536731:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.536758:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790778978.536765:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.536772:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4dc00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778978.536776:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.536786:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778978.536794:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778978.536800:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790778978.536803:0:5936:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790778978.536833:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.536839:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790778978.536892:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531614720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778978.536956:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778978.537040:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537047:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4dc00/0xdc876326560748d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748dc expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537063:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778978.537066:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537071:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a800 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778978.537079:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537086:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778978.537093:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778978.537097:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790778978.537099:0:5936:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1790778978.537112:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537118:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778978.537137:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537144:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778978.537146:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778978.537148:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778978.537156:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790778978.537167:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531614848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778978.537192:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778978.537268:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614720 00000100:00100000:3.0:1790778978.537274:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614720 00000100:00100000:3.0:1790778978.537332:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614848 00000100:00100000:3.0:1790778978.537336:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614848 00000100:00100000:3.0:1790778978.537360:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790778978.537369:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:763f742b-0483-425a-8826-84839ee976ad+19:3440:x1877767531614720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778978.537383:0:12059:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778978.537399:0:12059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef201499c00/0xdc876326560748dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560748d5 expref: 19 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778978.537422:0:12059:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778978.537528:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790778978.537536:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+18:3442:x1877767531614848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790778978.537545:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790778978.537555:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a1000/0xdc876326560747f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560747ee expref: 18 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.537581:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790778978.537611:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+17:3442:x1877767531614848:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778978.537618:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790778978.537660:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531614848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790778978.537737:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790778978.537743:0:13331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc876326560747ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560747f5 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778978.537758:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790778978.537768:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537777:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537790:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537797:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537811:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790778978.537817:0:13331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537824:0:13331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537830:0:13331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537836:0:13331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778978.537846:0:13331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790778978.537849:0:13331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1790778978.537852:0:13331:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1790778978.537881:0:13331:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790778978.537886:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790778978.537891:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790778978.537896:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1790778978.537902:0:13331:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ef235fc0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790778978.537907:0:13331:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ef235b08000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790778978.537921:0:13331:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9ef2365bd800 4dac8e38-11f9-42ba-9bac-432079f13049 192.168.202.2@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790778978.537927:0:13331:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9ef205c119c0) has exports, disconnecting them 00000020:00080000:2.0:1790778978.537931:0:13331:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ef235fc0800), last request at 1790778978 00000020:00000080:2.0:1790778978.537939:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560747b6 00000100:00080000:2.0:1790778978.537957:0:13331:0:(import.c:65:import_set_state_nolock()) ffff9ef235fc2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790778978.538002:0:13331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef235fc0800): rc 0 00000020:00000080:2.0:1790778978.538005:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef235fc0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1790778978.538015:0:13331:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ef235b08000), last request at 1790778978 00000020:00000080:2.0:1790778978.538018:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560746eb 00000100:00080000:2.0:1790778978.538023:0:13331:0:(import.c:65:import_set_state_nolock()) ffff9ef23586c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790778978.538029:0:13331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef235b08000): rc 0 00000020:00000080:2.0:1790778978.538031:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef235b08000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1790778978.538038:0:13331:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaac180d87ae0 00000100:00080000:2.0:1790778978.538061:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790778978.538064:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1790778978.538075:0:13331:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790778978.538131:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790778978.538145:0:13331:0:(import.c:65:import_set_state_nolock()) ffff9ef23333c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790778978.538156:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790778978.538158:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1790778978.538167:0:13331:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790778978.538223:0:13331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790778978.538231:0:13331:0:(import.c:65:import_set_state_nolock()) ffff9ef235dc4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790778978.538259:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ef205c119c0) has no exports 00010000:00010000:1.0:1790778978.538410:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790778978.538416:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538423:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4de00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778978.538426:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538436:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778978.538469:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778978.538476:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790778978.538478:0:6950:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790778978.538480:0:6950:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790778978.538501:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538507:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790778978.538520:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538541:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4de00/0xdc87632656074af0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc87632656074af7 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538552:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790778978.538556:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538562:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790778978.538565:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538573:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778978.538580:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778978.538585:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790778978.538588:0:6950:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790778978.538590:0:6950:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790778978.538605:0:6950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.538611:0:6950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790778978.538972:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:763f742b-0483-425a-8826-84839ee976ad+16:3440:x1877767531614720:12345-0@lo:103:ldlm_bl.0 Request processed in 1602us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778978.538981:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:3.0:1790778978.539013:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235fc0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790778978.539057:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235b08000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790778978.539080:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef235fc2000 for lustre-MDT0000 00000020:00000080:3.0:1790778978.539085:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef23586c800 for lustre-MDT0000 00010000:00010000:1.0:1790778978.539125:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.539133:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab400/0xdc876326560745a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560745a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778978.539157:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778978.539159:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778978.539161:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778978.539176:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531615232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778978.539231:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778978.539326:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778978.539336:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531614976:0@lo:9:umount.0 00000100:00100000:1.0:1790778978.539363:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778978.539385:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531615104:0@lo:9:umount.0 00000100:00100000:1.0:1790778978.539407:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778978.539439:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531614976 00000100:00100000:1.0:1790778978.539467:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531614976 00000100:00100000:1.0:1790778978.539506:0:12307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615104 00000100:00100000:1.0:1790778978.539510:0:12307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615104 00000100:00100000:1.0:1790778978.539529:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790778978.539538:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3438:x1877767531614976:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790778978.539569:0:12307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074738 00000100:00080000:1.0:1790778978.539579:0:12307:0:(import.c:65:import_set_state_nolock()) ffff9ef23586a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790778978.539636:0:12307:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790778978.539773:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3438:x1877767531614976:12345-0@lo:9:umount.0 Request processed in 237us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778978.539781:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790778978.539794:0:12307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790778978.539800:0:12307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3438:x1877767531615104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790778978.539813:0:12307:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607481f 00000100:00080000:1.0:1790778978.539818:0:12307:0:(import.c:65:import_set_state_nolock()) ffff9ef236267000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790778978.539847:0:12307:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1790778978.539928:0:12307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3438:x1877767531615104:12345-0@lo:9:umount.0 Request processed in 127us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790778978.539935:0:12307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790778978.540699:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531614720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778978.540722:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790778978.540731:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531615360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778978.540773:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790778978.541128:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778978.541135:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790778978.541163:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef23333c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790778978.541180:0:3438:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790778978.541183:0:3438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790778978.541187:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef235c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531614976:0@lo:9:umount.0 00000100:00080000:1.0:1790778978.541201:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef235dc4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790778978.541206:0:3438:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790778978.541207:0:3438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790778978.541210:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531615104:0@lo:9:umount.0 00000001:00100000:1.0:1790778978.542438:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790778978.542467:0:6930:0:(genops.c:885:class_export_put()) final put ffff9ef23586f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790778978.542486:0:6930:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:1.0:1790778978.542489:0:6930:0:(genops.c:885:class_export_put()) final put ffff9ef207d35800/b53b344e-0d4c-4209-a606-d24036760c61 00000001:00100000:1.0:1790778978.542624:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790778978.542629:0:8008:0:(genops.c:885:class_export_put()) final put ffff9ef236260800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790778978.542637:0:8008:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b53b344e-0d4c-4209-a606-d24036760c61 00000020:00000080:1.0:1790778978.542640:0:8008:0:(genops.c:885:class_export_put()) final put ffff9ef236557000/b53b344e-0d4c-4209-a606-d24036760c61 00000100:00100000:3.0:1790778978.542980:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615232 00000100:00100000:3.0:1790778978.542991:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615232 00000100:00100000:3.0:1790778978.543043:0:5933:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615360 00000100:00100000:3.0:1790778978.543047:0:5933:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615360 00000100:00100000:3.0:1790778978.543067:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778978.543075:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240df6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+17:3442:x1877767531615232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778978.543089:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778978.543119:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014abe00/0xdc87632656074af7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc87632656074af0 expref: 17 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778978.543137:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778978.543201:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240df6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+16:3442:x1877767531615232:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778978.543208:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790778978.543263:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790778978.543269:0:5933:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+15:3440:x1877767531615360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790778978.543277:0:5933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790778978.543298:0:5933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165ac00/0xdc876326560745a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560745a2 expref: 15 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778978.543310:0:5933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790778978.543341:0:5933:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:763f742b-0483-425a-8826-84839ee976ad+14:3440:x1877767531615360:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778978.543348:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:3.0:1790778978.543380:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef23586f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790778978.543424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef207d35800/b53b344e-0d4c-4209-a606-d24036760c61 for lustre-OST0000 00000020:00000080:3.0:1790778978.543469:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef236260800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790778978.543487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef236557000/b53b344e-0d4c-4209-a606-d24036760c61 for lustre-OST0001 00000020:00000080:3.0:1790778978.543505:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef23586a000 for lustre-OST0000 00000020:00000080:3.0:1790778978.543510:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef215c18800 for lustre-OST0000 00000020:00000080:3.0:1790778978.543514:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef236267000 for lustre-OST0001 00000020:00000080:3.0:1790778978.543518:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef236555000 for lustre-OST0001 00000100:00100000:3.0:1790778978.543562:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:763f742b-0483-425a-8826-84839ee976ad:3442:1877767531615232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790778978.543796:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778978.543821:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531615360:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790778978.549985:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ef205c119c0) has no exports 00000020:00000080:1.0:1790778978.608933:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560745fd 00000020:00000080:1.0:1790778978.608951:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef233118000/lustre-QMT0000_UUID 00000020:01000000:1.0:1790778978.609017:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1790778978.609138:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef233118000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790778978.609839:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790778978.609850:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790778978.609855:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9ef205c13380) has no exports 00000020:00000080:0.0:1790778978.610165:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560745f6 00000020:00000080:0.0:1790778978.610175:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef2330ba800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790778978.610234:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2330ba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790778978.610310:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790778978.610319:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790778978.610321:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef2330bd800/lustre-QMT0000_UUID 00000020:00000080:0.0:1790778978.610334:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2330bd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790778978.610343:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1790778979.083786:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778980.108930:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778981.132217:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790778981.906875:0:5927:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4dac8e38-11f9-42ba-9bac-432079f13049 00000001:00080000:0.0:1790778981.906893:0:5927:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1790778981.906899:0:5927:0:(genops.c:885:class_export_put()) final put ffff9ef2365bd800/4dac8e38-11f9-42ba-9bac-432079f13049 00000020:00000080:3.0:1790778981.906964:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2365bd800/4dac8e38-11f9-42ba-9bac-432079f13049 for lustre-MDT0000 00000020:00000080:3.0:1790778981.907735:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef2365b9800 for lustre-MDT0000 00010000:00010000:1.0:1790778982.157668:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778983.183308:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778983.436753:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531615744:0@lo:400:kworker.0 00000100:00100000:2.0:1790778983.436753:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531615616:0@lo:400:kworker.0 00000100:00100000:1.0:1790778983.436819:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790778983.436833:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531615488:0@lo:400:kworker.0 00000100:00100000:2.0:1790778983.436970:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778983.437984:0:7119:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615616 00000100:00100000:0.0:1790778983.437998:0:7119:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615616 00000100:00100000:0.0:1790778983.438090:0:7119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790778983.438098:0:7119:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3441:x1877767531615616:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790778983.438110:0:7119:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790778983.438382:0:7119:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3441:x1877767531615616:12345-0@lo:400:kworker.0 Request processed in 281us (1411us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790778983.438392:0:7119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1790778983.438565:0:3441:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790778983.438589:0:3441:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1790778983.438589:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02000400:2.0:1790778983.438594:0:3441:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790778983.438709:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778983.438759:0:5944:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615488 00000100:00100000:3.0:1790778983.438764:0:5944:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615488 00000100:00100000:3.0:1790778983.438801:0:5944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1790778983.438809:0:5944:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:3439:x1877767531615488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790778983.438851:0:5944:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20858ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:763f742b-0483-425a-8826-84839ee976ad+14:3439:x1877767531615488:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790778983.438858:0:5944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1790778983.438904:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615744 00000100:00100000:3.0:1790778983.438908:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615744 00000100:00100000:3.0:1790778983.438929:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790778983.438934:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3442:x1877767531615744:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790778983.438941:0:5951:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790778983.439944:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:763f742b-0483-425a-8826-84839ee976ad:3439:1877767531615488:0@lo:400:kworker.0 00000100:00100000:3.0:1790778983.440328:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3442:x1877767531615744:12345-0@lo:400:kworker.0 Request processed in 1389us (1615us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790778983.440340:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1790778983.440400:0:3442:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790778983.440406:0:3442:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790778983.440411:0:3442:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790778983.440417:0:3442:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790778983.440422:0:3442:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 180 00000100:00080000:3.0:1790778983.440434:0:3442:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ef236261800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1790778983.440514:0:3442:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2365caa00 x1877767531615872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790778983.440547:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3442:1877767531615744:0@lo:400:kworker.0 00000100:00100000:3.0:1790778983.440607:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531615872:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790778983.440799:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778983.440918:0:5949:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531615872 00000100:00100000:1.0:1790778983.440926:0:5949:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531615872 00000100:00100000:1.0:1790778983.441347:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1790778983.441356:0:5949:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531615872:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1790778983.441375:0:5949:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790778983.460902:0:5949:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531615872:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 19534us (20091us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790778983.460922:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:3.0:1790778983.461113:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790778983.461121:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790778983.461127:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531615872:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1790778983.470425:0:3441:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790778983.470492:0:3441:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 155 00000100:00080000:2.0:1790778983.470518:0:3441:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ef235b09800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778983.470588:0:3441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7c000 x1877767531616000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790778983.470694:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531615616:0@lo:400:kworker.0 00000100:00100000:3.0:1790778983.470935:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531616000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790778983.471035:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790778983.471164:0:5951:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531616000 00000100:00100000:1.0:1790778983.471181:0:5951:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531616000 00000100:00100000:1.0:1790778983.471251:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1790778983.471264:0:5951:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1877767531616000:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1790778983.471285:0:5951:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790778983.471386:0:5951:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1877767531616000:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 123us (350us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790778983.471394:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1790778983.474592:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790778983.474613:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790778983.474745:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531616000:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1790778984.203672:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790778984.651623:0:13331:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef23622cf60 - data ffff9ef22154e1b0/ffff9ef235e33400 00000020:01000000:2.0:1790778984.651796:0:13331:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef227a93b40 - data ffff9ef22f543948/ffff9ef2330cf400 00000001:00000004:2.0:1790778984.657956:0:13331:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1790778984.729433:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790778984.729464:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1790778984.729494:0:13331:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790778984.729498:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790778984.730814:0:7116:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790778984.730821:0:7116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1790778984.730834:0:7116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790778984.732918:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790778984.732927:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1790778984.732947:0:13331:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790778984.732950:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790778984.734950:0:8473:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790778984.734960:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790778984.734984:0:8473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790778984.741081:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560745c5 00000020:00000080:3.0:1790778984.741096:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef206dae000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790778984.742075:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206dae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790778984.744991:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560745da 00000020:00000080:3.0:1790778984.745008:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef206dab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790778984.745478:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790778984.745497:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790778984.745508:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790778984.745512:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9ef205c10000) has no exports 00000004:01000000:3.0:1790778984.745736:0:13331:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790778984.745748:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074818 00000020:00000080:3.0:1790778984.745756:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef235dc1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790778984.747831:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206dab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790778984.748118:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790778984.751156:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778984.751177:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790778984.751184:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9ef23b9a3380) has no exports 00000020:00000080:1.0:1790778984.751196:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074811 00000020:00000080:1.0:1790778984.751207:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef235dc7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790778984.751282:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235dc1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1790778984.752417:0:13331:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790778984.752425:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790778984.752633:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1790778984.752641:0:13331:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790778984.752644:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790778984.752844:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235dc7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790778984.753265:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778984.753281:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790778984.753293:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074731 00000020:00000080:1.0:1790778984.753305:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef23586c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790778984.753373:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef235dc4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790778984.753382:0:36:0:(genops.c:885:class_export_put()) final put ffff9ef235fc3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790778984.753385:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235fc3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790778984.753391:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790778984.753813:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790778984.753822:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778984.753830:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790778984.753835:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9ef2331e3380) has no exports 00000020:00000080:1.0:1790778984.753844:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607472a 00000020:00000080:1.0:1790778984.753851:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef233338800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1790778984.754317:0:13331:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790778984.754322:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790778984.754327:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1790778984.754333:0:13331:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790778984.754336:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790778984.754368:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778984.754374:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790778984.754405:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778984.754409:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790778984.754412:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef206dae800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790778984.754415:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206dae800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790778984.754429:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790778984.754877:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560745e1 00000020:00000080:1.0:1790778984.754883:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef206dac000/lustre-MDD0000_UUID 00000020:01000000:1.0:1790778984.754887:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790778984.754891:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778984.754894:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790778984.754897:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9ef205c14d40) has no exports 00000020:00000080:1.0:1790778984.754914:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778984.754928:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790778984.754931:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560745e8 00000020:00000080:1.0:1790778984.754935:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef206daf800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790778984.754942:0:13331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef211145000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790778984.754945:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef211145000 3 00000020:01000004:1.0:1790778984.754948:0:13331:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef211145000 from lustre-MDT0000 00000020:00000080:1.0:1790778984.754965:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778984.754968:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790778984.754970:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef206dac800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790778984.754973:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206dac800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790778984.754980:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790778984.755009:0:13331:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1790778984.755014:0:13331:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790778984.755017:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790778984.755019:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778984.755022:0:13331:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790778984.755030:0:13331:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9ef240ef2000 763f742b-0483-425a-8826-84839ee976ad 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790778984.755035:0:13331:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9ef220160000) has exports, disconnecting them 00000020:00080000:1.0:1790778984.755039:0:13331:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ef240ef2000), last request at 1790778740 00000020:00000080:1.0:1790778984.755052:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074586 00000020:00010000:1.0:1790778984.755056:0:13331:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ef240ef2000: total 4 00000100:00080000:1.0:1790778984.755061:0:13331:0:(import.c:65:import_set_state_nolock()) ffff9ef220a32800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1790778984.755164:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef23586c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790778984.755173:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef233338800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790778984.755178:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef23333c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790778984.755184:0:36:0:(genops.c:885:class_export_put()) final put ffff9ef2358c7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790778984.755187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2358c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790778984.755190:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790778984.755297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206dac000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790778984.755301:0:36:0:(genops.c:885:class_export_put()) final put ffff9ef206dad000/lustre-MDD0000_UUID 00000020:00000080:0.0:1790778984.755303:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206dad000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790778984.755307:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790778984.755515:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef206daf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1790778984.755570:0:13331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef240ef2000): rc 0 00000020:00080000:1.0:1790778984.755575:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9ef220160000) has no exports 00000100:00100000:1.0:1790778984.755809:0:5943:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ef2111cf800:5943] 1 exiting: rc = 0 00000100:00100000:1.0:1790778984.755911:0:5944:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ef2111cfa00:5944] 2 exiting: rc = 0 00000100:00100000:0.0:1790778984.756393:0:5942:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ef2053bc400:5942] 0 exiting: rc = 1 00000020:00010000:3.0:1790778984.756512:0:5936:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ef240ef2000: total 0 00010000:00010000:1.0:1790778984.756742:0:5936:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef240ef2000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1790778984.756779:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4d600/0xdc87632656074896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc8763265607488f expref: 9 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756798:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4d200/0xdc876326560748a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc8763265607489d expref: 8 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756823:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236387a00/0xdc876326560748b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560748ab expref: 7 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756836:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235e4c600/0xdc87632656074adb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc87632656074ad4 expref: 6 pid: 5942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756847:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236386e00/0xdc876326560748c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560748b9 expref: 5 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756858:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a0c00/0xdc876326560748ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc876326560748e3 expref: 4 pid: 5944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756872:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef236386000/0xdc87632656074ae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc87632656074ae2 expref: 3 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756886:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a1e00/0xdc8763265607469e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdc87632656074697 expref: 2 pid: 5943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778984.756896:0:5936:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef240ef2000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1790778984.756912:0:5936:0:(genops.c:885:class_export_put()) final put ffff9ef240ef2000/763f742b-0483-425a-8826-84839ee976ad 00010000:00010000:1.0:1790778984.756932:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778984.756935:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778984.756937:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790778984.756973:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.756983:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.756990:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.756998:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757005:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757012:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757018:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757034:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757041:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757050:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757056:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757064:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757072:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757079:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757085:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757092:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757099:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757106:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757113:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790778984.757262:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef240ef2000/763f742b-0483-425a-8826-84839ee976ad for MGS 00000020:00000080:0.0:1790778984.757308:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef220a32800 for MGS 00000100:00100000:1.0:1790778984.757368:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757380:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757387:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757393:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757399:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757407:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757413:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757419:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757425:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757431:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757436:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757511:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757519:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757525:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757531:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757537:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757543:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757548:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757554:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757559:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757565:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757571:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757576:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757592:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757766:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757774:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757779:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757785:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757790:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757796:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757801:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757806:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757812:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757817:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757823:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757828:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757833:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757838:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757843:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757849:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757854:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757859:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757865:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757870:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.757875:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1790778984.766335:0:13331:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef2200df8a0 - data ffff9ef22f6b60d8/ffff9ef235e3c400 00000020:01000000:0.0:1790778984.766524:0:13331:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef20880d8a0 - data ffff9ef21182faf8/ffff9ef2051de400 00000020:00000080:0.0:1790778984.767012:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607456a 00000020:00000080:0.0:1790778984.767020:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef207d31000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790778984.767036:0:13331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef211145000 from MGS, refs=2 00000020:01000004:0.0:1790778984.767040:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef211145000 2 00000020:01000004:0.0:1790778984.767044:0:13331:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef211145000 from MGS 00000020:00000080:0.0:1790778984.767068:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790778984.767075:0:13331:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790778984.767078:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef211147000/MGS 00000020:00000080:0.0:1790778984.767080:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef211147000/MGS for MGS 00000020:01000000:0.0:1790778984.767087:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790778984.767170:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790778984.767175:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790778984.767181:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790778984.767189:0:13331:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ef20d3d0800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790778984.767206:0:13331:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9ef2331e19c0) has exports, disconnecting them 00000020:00080000:0.0:1790778984.767211:0:13331:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ef20d3d0800), last request at 1790778740 00000020:00000080:0.0:1790778984.767216:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074635 00000020:00080000:0.0:1790778984.767237:0:13331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef20d3d0800): rc 0 00000020:00000080:0.0:1790778984.767241:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef20d3d0800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790778984.770269:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef207d31000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790778984.770296:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef20d3d0800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790778984.770424:0:13331:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790778984.770432:0:13331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790778984.770437:0:13331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790778984.770467:0:13331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790778984.770961:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778984.770971:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790778984.770979:0:13331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef211145000 1 00000020:00000080:1.0:1790778984.770984:0:13331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc8763265607455c 00000020:00000080:1.0:1790778984.770993:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef211144000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790778984.770999:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790778984.771007:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778984.771011:0:13331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790778984.771028:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9ef220163380) has no exports 00000020:00000080:3.0:1790778984.771807:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef20d3d2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790778984.771817:0:38:0:(genops.c:885:class_export_put()) final put ffff9ef20d3d4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790778984.771820:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef20d3d4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790778984.771825:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790778984.771917:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef211144000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790778984.873561:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790778984.873579:0:13331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1790778984.873585:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef211143800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790778984.873590:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef211143800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1790778984.873603:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1790778984.873741:0:13331:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ef211144800 00000020:01000000:2.0:1790778984.873766:0:13331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1790778984.873770:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790778984.873774:0:13331:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790778984.873779:0:13331:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9ef220164d40) has no exports 00000100:00100000:2.0:1790778984.873894:0:5950:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9ef227aee200:5950] 1 exiting: rc = 0 00000100:00100000:2.0:1790778984.874047:0:12797:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff9ef2364f1200:12797] 4 exiting: rc = 0 00000100:00100000:2.0:1790778984.874146:0:5951:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9ef2088f9200:5951] 2 exiting: rc = 0 00000100:00100000:2.0:1790778984.874234:0:5949:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9ef204ccb400:5949] 0 exiting: rc = 1 00000100:00100000:2.0:1790778984.874362:0:7119:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9ef235c6c200:7119] 3 exiting: rc = 0 00000100:00100000:2.0:1790778984.874469:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874496:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874507:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874518:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874529:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874541:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874552:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874565:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874576:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874588:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874598:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874605:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874612:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874621:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874631:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874639:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874646:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874653:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874660:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874667:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874674:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874681:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874690:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874698:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874706:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874714:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874722:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874729:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874738:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874746:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874754:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874761:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874769:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874776:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874784:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874791:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874806:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874811:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874817:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874822:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874827:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874832:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874837:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874843:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874848:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874855:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874860:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874866:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874873:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874880:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874887:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874894:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874901:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874908:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874916:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874922:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874929:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874936:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874945:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874952:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874959:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874969:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.874980:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.875002:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.881587:0:5953:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ef2088f9c00:5953] 1 exiting: rc = 0 00000100:00100000:2.0:1790778984.881909:0:5952:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ef212440800:5952] 0 exiting: rc = 1 00000100:00100000:1.0:1790778984.882022:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882031:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882038:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882044:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882052:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882058:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882065:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882072:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882077:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882083:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882089:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882095:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882104:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882111:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882117:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882181:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882190:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882196:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882201:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882206:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882211:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882225:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882231:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882236:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882241:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882245:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882251:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882256:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882261:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882267:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882272:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882277:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882282:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882287:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882309:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882315:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882320:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882326:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882330:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882336:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882342:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882347:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882352:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882357:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882363:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882368:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882373:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882378:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882383:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882388:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882394:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882400:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882405:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882411:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882417:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882424:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882430:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882436:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882987:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.882995:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.883000:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.883006:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.883012:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.883018:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.885175:0:5954:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9ef212441400:5954] 0 exiting: rc = 1 00000100:00100000:0.0:1790778984.885392:0:5955:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9ef212440000:5955] 1 exiting: rc = 0 00000100:00100000:1.0:1790778984.885551:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885561:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885569:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885576:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885583:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885602:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885619:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885636:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885646:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885652:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885659:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885666:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885673:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885680:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885687:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885692:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885699:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885705:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885711:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885733:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885744:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885750:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885755:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885761:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885767:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885773:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885778:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885785:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885791:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885798:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885804:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885826:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885833:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885839:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885845:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885852:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885858:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885864:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885870:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885876:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885890:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885898:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885905:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885925:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885932:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885938:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885945:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885953:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885960:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885966:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885973:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885979:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885984:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885991:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.885997:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886019:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886026:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886032:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886040:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886045:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886050:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886056:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886062:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.886076:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778984.896042:0:5956:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ef2088f8000:5956] 0 exiting: rc = 1 00000100:00100000:0.0:1790778984.896196:0:5957:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ef240e09a00:5957] 1 exiting: rc = 0 00000100:00100000:1.0:1790778984.896374:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896383:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896389:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896395:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896402:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896410:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896416:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896422:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896428:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896433:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896479:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896504:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896509:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896516:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896521:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896527:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896533:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896539:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896544:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896549:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896555:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896560:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896566:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896572:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896578:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896583:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896590:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896595:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896600:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896604:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896687:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896697:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896702:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896708:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896714:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896719:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896725:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896730:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896737:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896743:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896748:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896753:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896758:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896763:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896769:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896774:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896788:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896794:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896799:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896804:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896810:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896816:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896821:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896826:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896832:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896839:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896844:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896850:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896856:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896861:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896867:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896873:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896879:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.896885:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778984.897604:0:5958:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ef240e5b000:5958] 0 exiting: rc = 1 00000100:00100000:2.0:1790778984.897881:0:5959:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ef240e09e00:5959] 1 exiting: rc = 0 00000100:00100000:1.0:1790778984.898082:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898090:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898096:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898102:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898109:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898114:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898247:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898258:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898265:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898271:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898277:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898282:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898288:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898293:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898299:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898304:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898310:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898326:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898331:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898335:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898340:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898346:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898350:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898356:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898361:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898367:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898374:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898379:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898385:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898391:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898396:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898402:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898408:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898414:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898420:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898426:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898431:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898437:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898544:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898553:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898559:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898565:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898570:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898576:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898582:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898587:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898592:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898598:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898604:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898681:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898691:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898697:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898712:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898718:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898724:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898729:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898735:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898740:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898746:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898751:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898757:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898763:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898768:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778984.898773:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778984.899996:0:5960:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ef240e5b200:5960] 0 exiting: rc = 1 00000100:00100000:1.0:1790778984.900275:0:5961:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ef2088fbe00:5961] 1 exiting: rc = 0 00000100:00100000:2.0:1790778984.900414:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900423:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900429:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900434:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900858:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900875:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900881:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900886:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900891:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900896:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900901:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900906:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900911:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900916:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900921:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900926:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900930:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900934:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900938:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900943:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900948:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900952:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900957:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900962:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900966:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900971:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900976:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900981:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900985:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900990:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.900995:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901000:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901005:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901009:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901014:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901018:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901022:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901027:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901032:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901037:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901050:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901056:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901061:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901066:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901072:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901077:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901083:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901088:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901094:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901099:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901106:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901111:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901116:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901287:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901297:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901302:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901307:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901313:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901318:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901325:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901330:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901335:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901340:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778984.901346:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778984.902544:0:5962:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9ef2201d5e00:5962] 0 exiting: rc = 1 00000100:00100000:3.0:1790778984.903973:0:5964:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9ef2201d4000:5964] 2 exiting: rc = 0 00000100:00100000:1.0:1790778984.904615:0:5963:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9ef2201d5400:5963] 1 exiting: rc = 0 00000100:00100000:3.0:1790778984.904880:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904889:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904898:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904905:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904911:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904917:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904924:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904931:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904938:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904945:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904953:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904959:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904964:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904987:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904992:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.904999:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905005:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905028:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905037:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905045:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905050:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905057:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905064:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905070:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905077:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905082:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905089:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905095:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905102:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905108:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905113:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905119:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905238:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905246:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905253:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905259:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905266:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905272:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905280:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905286:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905291:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905312:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905320:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905326:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905333:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905339:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905345:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905352:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905365:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905370:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905376:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905381:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905386:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905392:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905397:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905403:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905409:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905414:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905420:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905425:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905430:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905435:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905470:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778984.905478:0:13331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790778984.913725:0:13331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790778984.913813:0:13331:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1790778984.913820:0:13331:0:(genops.c:885:class_export_put()) final put ffff9ef208fcf800/MDS_uuid 00000020:00000080:0.0:1790778984.913824:0:13331:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef208fcf800/MDS_uuid for MDS 00000020:01000000:0.0:1790778984.913835:0:13331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1790778984.914302:0:13331:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790778985.235437:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778986.251590:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790778987.276551:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778988.300635:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790778988.555828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790778988.555838:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790778988.555842:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790778988.555853:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 377 00000100:00080000:2.0:1790778988.555860:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790778988.555874:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ef235b09800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778988.555900:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7ed80 x1877767531616256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790778988.555920:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1790778988.555930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790778988.555933:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790778988.555935:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790778988.555939:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 377 00000100:00080000:2.0:1790778988.555941:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1790778988.555943:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531616128:0@lo:400:kworker.0 00000100:00080000:2.0:1790778988.555946:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ef236261800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778988.555959:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7df80 x1877767531616384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790778988.555982:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531616256:0@lo:38:kworker.0 00000400:00000100:2.0:1790778988.556009:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767531616256 offset 0 length 520: 4 00000400:00000100:0.0:1790778988.556009:0:3440:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767531616128 offset 0 length 224: 4 00000100:00100000:2.0:1790778988.556212:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531616384:0@lo:38:kworker.0 00000400:00000100:2.0:1790778988.556231:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767531616384 offset 0 length 520: 4 00000020:01000004:2.0:1790778988.725629:0:13533:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790778988.749849:0:13533:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790778988.749909:0:13533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.749925:0:13533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.749934:0:13533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.749956:0:13533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.749976:0:13533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790778988.749983:0:13533:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1790778988.750013:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790778988.750019:0:5937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.750027:0:5937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:0.0:1790778988.750030:0:5937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.750040:0:5937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790778988.750047:0:5937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790778988.750053:0:5937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790778988.750056:0:5937:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790778988.750058:0:5937:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790778988.750092:0:5937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.750099:0:5937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790778988.750131:0:5937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.750139:0:5937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4c400/0xdc876326560748ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748b2 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790778988.750157:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778988.750159:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778988.750161:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790778988.750195:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531616512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790778988.750263:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790778988.750332:0:5935:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531616512 00000100:00100000:0.0:1790778988.750338:0:5935:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531616512 00000100:00100000:0.0:1790778988.750374:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790778988.750382:0:5935:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3440:x1877767531616512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790778988.750389:0:5935:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790778988 with bad export cookie 15890778826503308678 00000100:00080000:2.0:1790778988.754507:0:13533:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790778988.754524:0:13533:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef236b7ed80 x1877767531616256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790778988.754544:0:13533:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790778988.754573:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790778988.754578:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1790778988.754582:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531616256:0@lo:38:kworker.0 00000100:00080000:2.0:1790778988.754608:0:13533:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790778988.754615:0:13533:0:(import.c:65:import_set_state_nolock()) ffff9ef235b09800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790778988.754621:0:13533:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790778988.754637:0:13533:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790778988.754641:0:13533:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790778988.762984:0:13533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763006:0:13533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763013:0:13533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763020:0:13533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763040:0:13533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790778988.763047:0:13533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763054:0:13533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763062:0:13533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763068:0:13533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778988.763079:0:13533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790778988.763083:0:13533:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790778988.763105:0:13533:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790778988.763109:0:13533:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1790778988.763129:0:13533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790778988.763134:0:13533:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790778988.763138:0:13533:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9ef2331e4d40) has no exports 00000020:00080000:2.0:1790778988.763162:0:13533:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9ef2331e4d40) has no exports 00010000:00010000:3.0:1790778988.763323:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790778988.763331:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763339:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4da00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778988.763344:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763353:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778988.763360:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778988.763366:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790778988.763368:0:5936:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1790778988.763377:0:5936:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1790778988.763412:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763419:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778988.763480:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763488:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4da00/0xdc876326560748b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc876326560748c0 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763503:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790778988.763506:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763512:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0200 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778988.763515:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763523:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778988.763529:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778988.763535:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790778988.763537:0:5936:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790778988.763539:0:5936:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790778988.763550:0:5936:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763556:0:5936:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790778988.763572:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763579:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0200/0xdc87632656074ae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdc87632656074ae9 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778988.763587:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778988.763589:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778988.763591:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778988.763598:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790778988.763613:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531616640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778988.763681:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778988.763736:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790778988.763742:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531616768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790778988.763760:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790778988.763792:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531616640 00000100:00100000:3.0:1790778988.763799:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531616640 00000100:00100000:3.0:1790778988.763824:0:12059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531616768 00000100:00100000:3.0:1790778988.763826:0:12059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531616768 00000100:00100000:3.0:1790778988.763837:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778988.763844:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3441:x1877767531616640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790778988.763850:0:12059:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790778988 with bad export cookie 15890778826503308678 00000100:00100000:3.0:1790778988.763888:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3441:x1877767531616640:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (207us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790778988.763895:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790778988.763909:0:12059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790778988.763912:0:12059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3441:x1877767531616768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790778988.763916:0:12059:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790778988 with bad export cookie 15890778826503308678 00000100:00100000:3.0:1790778988.763937:0:12059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3441:x1877767531616768:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (176us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790778988.763949:0:12059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790778988.763979:0:3441:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790778988.763984:0:3441:0:(import.c:65:import_set_state_nolock()) ffff9ef208fc8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1790778988.763988:0:3441:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1790778988.769544:0:13533:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef207e82ae0 - data ffff9ef22f5a3438/ffff9ef2333cb400 00000020:01000000:2.0:1790778988.770032:0:13533:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef227ba0c00 - data ffff9ef22f63cca8/ffff9ef235874c00 00000100:00100000:0.0:1790778988.772088:0:5935:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3440:x1877767531616512:12345-0@lo:103:ldlm_bl.0 Request processed in 21700us (21819us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790778988.772102:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1790778988.772154:0:3440:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790778988.800263:0:3441:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.102@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1790778988.800269:0:3441:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790778988.800281:0:3441:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef236b7f800 x1877767531616128/t0(0) o400->MGC192.168.202.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790779004 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778988.800297:0:3441:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef2369baa00 x1877767531616512/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778988.800307:0:3441:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef2333dfb80 x1877767531616640/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779004 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790778988.800315:0:3441:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef2333dce00 x1877767531616768/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790778988.800337:0:3441:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790778988.800340:0:3441:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 00000100:00080000:0.0:1790778988.800340:0:3440:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ef208fc8800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1790778988.800342:0:3441:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790778988.800346:0:3441:0:(import.c:65:import_set_state_nolock()) ffff9ef208fc8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790778988.800351:0:3441:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 134 00000100:00080000:3.0:1790778988.800368:0:3441:0:(import.c:666:import_select_connection()) MGC192.168.202.102@tcp: import ffff9ef208fc8800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790778988.800504:0:3441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7ed80 x1877767531616896/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790778988.800549:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531616640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790778988.800574:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:763f742b-0483-425a-8826-84839ee976ad:3441:1877767531616768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790778988.800668:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531616128:0@lo:400:kworker.0 00000100:00100000:3.0:1790778988.800676:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:763f742b-0483-425a-8826-84839ee976ad:3438:1877767531616896:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:1.0:1790778988.800712:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:763f742b-0483-425a-8826-84839ee976ad:3440:1877767531616512:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1790778988.800722:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767531616896 offset 0 length 520: 4 00100000:10000000:0.0:1790778988.810645:0:13533:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790778988.830033:0:13533:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560746ba 00000020:00000080:2.0:1790778988.830049:0:13533:0:(genops.c:885:class_export_put()) final put ffff9ef2358c2000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790778988.830070:0:13533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef2332da000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790778988.830074:0:13533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef2332da000 2 00000020:01000004:2.0:1790778988.830077:0:13533:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef2332da000 from lustre-OST0000 00000020:00000080:2.0:1790778988.830102:0:13533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790778988.830113:0:13533:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790778988.830116:0:13533:0:(genops.c:885:class_export_put()) final put ffff9ef2358c5000/lustre-OST0000_UUID 00000020:00000080:2.0:1790778988.830120:0:13533:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2358c5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790778988.830127:0:13533:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790778988.830353:0:13533:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790778988.830359:0:13533:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790778988.830364:0:13533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790778988.830369:0:13533:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790778988.830377:0:13533:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ef235b0d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790778988.830383:0:13533:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9ef23b9a19c0) has exports, disconnecting them 00000020:00080000:2.0:1790778988.830389:0:13533:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ef235b0d800), last request at 1790778761 00000020:00000080:2.0:1790778988.830394:0:13533:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560746e4 00000020:00080000:2.0:1790778988.830416:0:13533:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef235b0d800): rc 0 00000020:00000080:2.0:1790778988.830421:0:13533:0:(genops.c:885:class_export_put()) final put ffff9ef235b0d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790778988.834531:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2358c2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790778988.834559:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235b0d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790778988.859934:0:13533:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790778988.859945:0:13533:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790778988.859950:0:13533:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790778988.859958:0:13533:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790778988.860210:0:13533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790778988.860220:0:13533:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1790778988.860229:0:13533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef2332da000 1 00000020:00000080:0.0:1790778988.860238:0:13533:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074674 00000020:00000080:0.0:1790778988.860263:0:13533:0:(genops.c:885:class_export_put()) final put ffff9ef23333a000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790778988.860271:0:13533:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790778988.860277:0:13533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790778988.860283:0:13533:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790778988.860288:0:13533:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9ef23b814d40) has no exports 00000020:00000080:1.0:1790778988.860698:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef235b09800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790778988.860708:0:38:0:(genops.c:885:class_export_put()) final put ffff9ef23333e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790778988.860711:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef23333e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790778988.860724:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790778988.860809:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef23333a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790778988.926763:0:13533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778988.926780:0:13533:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790778988.926787:0:13533:0:(genops.c:885:class_export_put()) final put ffff9ef2332dc000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790778988.927275:0:13533:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef2332dc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790778988.927290:0:13533:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790778988.927431:0:13533:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ef2332dc800 00000020:02000400:1.0:1790778988.927868:0:13533:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790778989.323585:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778990.347908:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778991.374715:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778992.395897:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790778992.829805:0:13734:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790778992.853733:0:13734:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790778992.853842:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.853858:0:13734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.853866:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.853873:0:13734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.853932:0:13734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790778992.853938:0:13734:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790778992.853963:0:13734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790778992.853975:0:13734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef236b7df80 x1877767531616384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778992.854000:0:13734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790778992.854006:0:13734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790778992.854012:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790778992.854017:0:13734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790778992.854021:0:13734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef236b7df80 x1877767531616384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779003 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790778992.854028:0:13734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790778992.854031:0:13734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1790778992.854187:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531616384:0@lo:38:kworker.0 00010000:00010000:1.0:1790778992.855237:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855251:0:13734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855269:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855276:0:13734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778992.855466:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790778992.855475:0:5936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778992.855495:0:5936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387200 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:3.0:1790778992.855500:0:5936:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778992.855509:0:5936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790778992.855517:0:5936:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790778992.855524:0:5936:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790778992.855527:0:5936:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:1.0:1790778992.855611:0:13734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790778992.855620:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855629:0:13734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855636:0:13734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855643:0:13734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.855654:0:13734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790778992.855657:0:13734:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790778992.855682:0:13734:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790778992.855687:0:13734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790778992.855691:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778992.855697:0:13734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790778992.855701:0:13734:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9ef2331e0000) has no exports 00000020:00080000:1.0:1790778992.855727:0:13734:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9ef2331e0000) has no exports 00010000:00010000:2.0:1790778992.856664:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790778992.856673:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856683:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386400 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790778992.856687:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856696:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778992.856704:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778992.856709:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790778992.856712:0:6950:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790778992.856715:0:6950:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790778992.856732:0:6950:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef208fc8800 00010000:00010000:2.0:1790778992.856736:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856742:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef236386400/0xdc8763265607489d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc876326560748a4 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856756:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790778992.856760:0:6950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856783:0:6950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1a00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790778992.856785:0:6950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856792:0:6950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790778992.856798:0:6950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790778992.856803:0:6950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790778992.856806:0:6950:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790778992.856808:0:6950:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790778992.856813:0:6950:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef208fc8800 00010000:00010000:2.0:1790778992.856816:0:6950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856823:0:6950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2358a1a00/0xdc87632656074ad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc87632656074adb expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790778992.856836:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778992.856838:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790778992.856840:0:6950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790778992.856923:0:5937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790778992.857055:0:5936:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790778992.857063:0:5936:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef208fc8800 00010000:00010000:3.0:1790778992.857067:0:5936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778992.857074:0:5936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef236387200/0xdc8763265607488f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc87632656074896 expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790778992.857082:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778992.857084:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790778992.857086:0:5936:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790778992.858972:0:13734:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef207e822a0 - data ffff9ef22f5be5e8/ffff9ef2363ec400 00000020:01000000:1.0:1790778992.859153:0:13734:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9ef207e828a0 - data ffff9ef22f64f438/ffff9ef2333cb800 00100000:10000000:1.0:1790778992.875321:0:13734:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790778992.883438:0:13734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074785 00000020:00000080:1.0:1790778992.883475:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef235d08800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790778992.883488:0:13734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef235b0c800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790778992.883492:0:13734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef235b0c800 2 00000020:01000004:1.0:1790778992.883496:0:13734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef235b0c800 from lustre-OST0001 00000020:00000080:1.0:1790778992.883517:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778992.883526:0:13734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790778992.883530:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef235d0c000/lustre-OST0001_UUID 00000020:00000080:2.0:1790778992.883538:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235d08800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790778992.883606:0:13734:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235d0c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790778992.883614:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790778992.883722:0:13734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 763f742b-0483-425a-8826-84839ee976ad->MGS 00010000:00010000:1.0:1790778992.883738:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778992.883750:0:13734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778992.883884:0:13734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790778992.883887:0:13734:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790778992.883891:0:13734:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790778992.883905:0:13734:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef208fc8800 00010000:00010000:1.0:1790778992.883909:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656074697 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc8763265607469e expref: -99 pid: 6928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790778992.883927:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790778992.883935:0:13734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790778992.883955:0:13734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790778992.883958:0:13734:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790778992.883960:0:13734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790778992.883969:0:13734:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef208fc8800 00010000:00010000:1.0:1790778992.883972:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235e4d000/0xdc876326560748e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdc876326560748ea expref: -99 pid: 5946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790778992.883989:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9ef208fc8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790778992.883993:0:13734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790778992.883995:0:13734:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790778992.883997:0:13734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790778992.884001:0:13734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790778992.884012:0:13734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef236b7ed80 x1877767531616896/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790778998 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790778992.884033:0:13734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790778992.884036:0:13734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1790778992.884195:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:763f742b-0483-425a-8826-84839ee976ad:3438:1877767531616896:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1790778992.885671:0:13734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790778992.885686:0:13734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074578 00000020:00000080:1.0:1790778992.885705:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef208fca800/763f742b-0483-425a-8826-84839ee976ad 00000020:01000000:1.0:1790778992.885723:0:13734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.102@tcp (flags='') 00000020:00000080:1.0:1790778992.885732:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778992.885739:0:13734:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790778992.885743:0:13734:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9ef2201619c0) has no exports 00000020:00000080:2.0:1790778992.886179:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef208fca800/763f742b-0483-425a-8826-84839ee976ad for MGC192.168.202.102@tcp 10000000:01000000:3.0:1790778992.886235:0:5946:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790778992.886491:0:13734:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.102@tcp: client import never connected 00000100:00080000:1.0:1790778992.886495:0:13734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790778992.886498:0:13734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790778992.886502:0:13734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790778992.886504:0:13734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790778992.886593:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef208fc8800 for MGC192.168.202.102@tcp 00000020:00000080:1.0:1790778992.886669:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790778992.886676:0:13734:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.102@tcp (uuid 763f742b-0483-425a-8826-84839ee976ad) 00000020:00000080:1.0:1790778992.886679:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef208fcd000/763f742b-0483-425a-8826-84839ee976ad 00000020:00000080:1.0:1790778992.886824:0:13734:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef208fcd000/763f742b-0483-425a-8826-84839ee976ad for MGC192.168.202.102@tcp 00000020:01000000:1.0:1790778992.886830:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.102@tcp (763f742b-0483-425a-8826-84839ee976ad) 00000020:01000000:1.0:1790778992.887093:0:13734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790778992.887098:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790778992.887103:0:13734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790778992.887110:0:13734:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ef235d0b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790778992.887115:0:13734:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9ef2362599c0) has exports, disconnecting them 00000020:00080000:1.0:1790778992.887120:0:13734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ef235d0b800), last request at 1790778786 00000020:00000080:1.0:1790778992.887124:0:13734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc876326560747af 00000020:00080000:1.0:1790778992.887150:0:13734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef235d0b800): rc 0 00000020:00000080:1.0:1790778992.887155:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef235d0b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790778992.887552:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235d0b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790778992.892490:0:13734:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790778992.892500:0:13734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790778992.892505:0:13734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790778992.892513:0:13734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790778992.892552:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ef236261800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1790778992.892571:0:6950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790778992.892712:0:5937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1790778992.892796:0:5936:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790778992.892908:0:5932:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ef203ace400:5932] 1 exiting: rc = 0 00000100:00100000:3.0:1790778992.892962:0:5931:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ef21273a600:5931] 0 exiting: rc = 1 00000100:00100000:2.0:1790778992.893194:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.893422:0:12059:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ef2363a1e00:12059] 3 exiting: rc = 0 00000100:00100000:3.0:1790778992.893529:0:5933:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ef227a11c00:5933] 0 exiting: rc = 1 00000100:00100000:2.0:1790778992.897558:0:5934:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ef227a11400:5934] 1 exiting: rc = 0 00000100:00100000:2.0:1790778992.901570:0:5935:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ef227a11200:5935] 2 exiting: rc = 0 00000100:00100000:3.0:1790778992.904928:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904939:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904945:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904951:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904971:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904982:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904989:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.904996:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905003:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905010:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905016:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905023:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905030:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905039:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905046:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905052:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905059:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905068:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905074:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905079:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905085:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905090:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905096:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905102:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905107:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905113:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905118:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905124:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905131:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905136:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905156:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905162:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905169:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905175:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905195:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905201:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905206:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905212:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905218:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905224:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905229:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905234:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905240:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905246:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905252:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905257:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905263:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905268:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905275:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905281:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905286:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905292:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905297:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905303:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905309:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905314:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905319:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905325:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905331:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905338:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905343:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905349:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905354:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790778992.905360:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790778992.906500:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790778992.906511:0:13734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790778992.906516:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef236267800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790778992.906521:0:13734:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef236267800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790778992.906526:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1790778992.906593:0:13734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef235b0c800 1 00000020:00000080:3.0:1790778992.906599:0:13734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdc87632656074754 00000020:00000080:3.0:1790778992.906606:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef235b0b800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790778992.906620:0:13734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790778992.906624:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790778992.906628:0:13734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790778992.906632:0:13734:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9ef23b9a4d40) has no exports 00000020:00000080:2.0:1790778992.911977:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235b0b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790778993.017038:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790778993.017051:0:13734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790778993.017058:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef235b0b000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790778993.017063:0:13734:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef235b0b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790778993.017073:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790778993.017393:0:13734:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ef235b0c000 00000020:01000000:2.0:1790778993.017417:0:13734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790778993.017421:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790778993.017426:0:13734:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790778993.017430:0:13734:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9ef23b9a0000) has no exports 00000020:00000080:2.0:1790778993.017478:0:13734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790778993.017484:0:13734:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790778993.017487:0:13734:0:(genops.c:885:class_export_put()) final put ffff9ef233339000/OSS_uuid 00000020:00000080:2.0:1790778993.017489:0:13734:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef233339000/OSS_uuid for OSS 00000020:01000000:2.0:1790778993.017493:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790778993.017578:0:12307:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9ef233201600:12307] 3 exiting: rc = 0 00000100:00100000:3.0:1790778993.018643:0:6937:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9ef2331eaa00:6937] 2 exiting: rc = 0 00000100:00100000:3.0:1790778993.018722:0:6934:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9ef203294400:6934] 0 exiting: rc = 1 00000100:00080000:0.0:1790778993.018811:0:5945:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790778993.019032:0:6935:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9ef203294000:6935] 1 exiting: rc = 0 00000100:00100000:2.0:1790778993.019128:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019156:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019165:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019173:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019179:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019198:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019203:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019209:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019214:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019218:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019225:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019230:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019236:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019242:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019248:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019253:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019260:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019265:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019270:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019275:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019280:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019285:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019290:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019295:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019301:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019306:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019312:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019317:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019323:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019328:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019333:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019338:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019343:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019349:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019354:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019359:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019364:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019370:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019375:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019381:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019395:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019401:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019406:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019411:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019417:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019423:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019429:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019434:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019477:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019484:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019489:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019494:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019499:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019504:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019510:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019515:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019521:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019527:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019532:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019538:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019544:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019549:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019554:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.019560:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.020363:0:8834:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ef233201400:8834] 2 exiting: rc = 0 00000100:00100000:0.0:1790778993.020468:0:6938:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ef2053bd000:6938] 0 exiting: rc = 1 00000100:00100000:3.0:1790778993.020582:0:6939:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ef208ca5200:6939] 1 exiting: rc = 0 00000100:00100000:2.0:1790778993.021357:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021367:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021373:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021379:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021384:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021390:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021396:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021401:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021407:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021414:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021420:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021773:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021782:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021787:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021792:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021798:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021803:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021808:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021814:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021819:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021825:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021830:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021836:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021841:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021846:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021852:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021858:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021864:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021869:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021875:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021881:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021886:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021892:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021897:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021902:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021907:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021912:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021917:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021923:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021928:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021934:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021939:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021944:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021950:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021955:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021960:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021975:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021981:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021987:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021992:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.021998:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022003:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022009:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022014:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022020:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022026:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022031:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022037:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022042:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022048:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022053:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022059:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022065:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022071:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.022903:0:6941:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ef2332bf400:6941] 1 exiting: rc = 0 00000100:00100000:0.0:1790778993.023250:0:6942:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ef227a39000:6942] 2 exiting: rc = 0 00000100:00100000:3.0:1790778993.023570:0:6940:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ef2332bee00:6940] 0 exiting: rc = 1 00000100:00100000:2.0:1790778993.027923:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027933:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027940:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027947:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027953:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027960:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027966:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027973:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027979:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027984:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027991:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.027996:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028016:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028023:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028028:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028034:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028053:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028060:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028067:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028076:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028083:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028090:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028096:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028102:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028107:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028114:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028119:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028127:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028132:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028151:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028159:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028166:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028172:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028177:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028183:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028190:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028212:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028219:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028225:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028231:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028237:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028243:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028249:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028255:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028261:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028266:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028272:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028277:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028282:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028288:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028293:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028308:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028314:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028320:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028325:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028331:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028336:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028342:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028348:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028354:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028360:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028366:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028372:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790778993.028385:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790778993.035119:0:6943:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ef227a38e00:6943] 0 exiting: rc = 1 00000100:00100000:3.0:1790778993.038557:0:6944:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ef227a38000:6944] 1 exiting: rc = 0 00000100:00100000:0.0:1790778993.038643:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038651:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038657:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038662:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038675:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038681:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038817:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038829:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038834:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038840:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038845:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038851:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038856:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038862:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038867:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038872:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038878:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038886:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038892:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038897:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038917:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038923:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038929:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038935:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038941:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038947:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038954:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038960:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038966:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038972:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038978:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038984:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038989:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.038995:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039001:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039007:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039012:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039018:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039024:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039029:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039035:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039041:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039046:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039052:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039057:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039063:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039069:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039074:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039080:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039086:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039091:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039097:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039103:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039108:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039114:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039127:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039133:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039159:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039169:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039177:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039183:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039189:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039194:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.039200:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040160:0:6945:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ef2332bea00:6945] 0 exiting: rc = 1 00000100:00100000:1.0:1790778993.040236:0:6946:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ef227a39e00:6946] 1 exiting: rc = 0 00000100:00100000:0.0:1790778993.040318:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040340:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040349:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040354:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040361:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040368:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040374:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040380:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040386:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040393:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040399:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040405:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040412:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040433:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040440:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040474:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040482:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040488:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040494:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040500:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040506:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040512:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040518:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040524:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040600:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040633:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040640:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040646:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040652:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040659:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040665:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040672:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040679:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040685:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040836:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040842:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040848:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040870:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040878:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040885:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040891:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040898:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040905:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040910:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040917:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040924:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040930:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040936:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040943:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040963:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040970:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040976:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040981:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040987:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040993:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.040999:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041005:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041011:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041017:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041024:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041037:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041043:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041049:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790778993.041061:0:13734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790778993.052403:0:13734:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790779010.648887:0:14394:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790779023.167701:0:14993:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790779023.167709:0:14993:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1790779023.167711:0:14993:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790779023.167840:0:14993:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef236c63800 00000020:01000004:0.0:1790779023.167872:0:14993:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790779023.167882:0:14993:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790779023.167898:0:14993:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ef2331e3380) 00000020:00000080:0.0:1790779023.167916:0:14993:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790779023.221049:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790779023.228233:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790779023.233587:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.234552:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790779023.235351:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.236353:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.237604:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790779023.238300:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790779023.238801:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.239654:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.239906:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.240316:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790779023.241661:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1790779023.242008:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790779023.242207:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790779023.244974:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790779023.245899:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1790779023.246715:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790779023.247104:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.250957:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.252074:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.252529:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790779023.252866:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790779023.253116:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.253388:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.253716:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.253972:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.254211:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790779023.254545:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790779023.254740:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790779023.254947:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790779023.255134:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790779023.255322:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1790779023.255987:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.256207:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.256563:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1790779023.256725:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.256897:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1790779023.257061:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.257221:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.257499:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.257664:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1790779023.257820:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.257991:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.258145:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.258305:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790779023.258640:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1790779023.260734:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1790779023.261101:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1790779023.261343:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1790779023.261882:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790779023.262095:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790779023.262319:0:14993:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1790779023.262912:0:14993:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790779023.263154:0:14993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790779023.263163:0:14993:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790779023.263176:0:14993:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc876326560758bf 00000020:01000004:1.0:1790779023.263183:0:14993:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790779023.263189:0:14993:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790779023.263195:0:14993:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef236c63800 from MGS 00000020:01000004:1.0:1790779023.263199:0:14993:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790779023.263216:0:14993:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ef23625cd40) 00000020:00000080:1.0:1790779023.263229:0:14993:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790779023.263320:0:14993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef236c63800 from MGS, refs=2 00080000:01000000:1.0:1790779023.263325:0:14993:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790779023.263331:0:14993:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc876326560758cd 00000100:00100000:1.0:1790779023.263688:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790779023.263833:0:14993:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790779023.263839:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790779023.264301:0:14993:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790779023.264308:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790779023.265330:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779023.265824:0:14993:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790779023.265830:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790779023.266576:0:14993:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790779023.266586:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790779023.266908:0:14993:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790779023.266914:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790779023.267765:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779023.267768:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779023.267771:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779023.268028:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779023.268031:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779023.268033:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779023.269597:0:14993:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790779023.273766:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790779023.275215:0:14993:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790779023.281487:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790779023.284531:0:14993:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790779023.284639:0:14993:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790779023.285749:0:14993:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790779023.286121:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779023.286336:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790779023.286343:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790779023.286999:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790779023.287007:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790779023.287229:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790779023.287234:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790779023.288221:0:14993:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:2.0:1790779023.288420:0:15010:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1790779023.288736:0:14993:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:0.0:1790779023.288738:0:14993:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790779023.288777:0:14993:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:0.0:1790779023.288793:0:14993:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.102@tcp (ffff9ef2331e0000) 00000020:00000080:0.0:1790779023.288813:0:14993:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790779023.288915:0:14993:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef236c60000@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1790779023.289093:0:14993:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:0.0:1790779023.289099:0:14993:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790779023.296712:0:15011:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790779023.296923:0:14993:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid 5971fcd9-bd47-4c7f-984b-89395cac9bc1) 00000020:00000080:0.0:1790779023.296951:0:14993:0:(genops.c:1384:class_connect()) connect: client 5971fcd9-bd47-4c7f-984b-89395cac9bc1, cookie 0xdc876326560758db 00000100:00080000:0.0:1790779023.296968:0:14993:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779023.296980:0:14993:0:(import.c:666:import_select_connection()) MGC192.168.202.102@tcp: import ffff9ef236c60000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1790779023.297029:0:14993:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2369bb100 x1877767531617024/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779023.297060:0:14993:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5971fcd9-bd47-4c7f-984b-89395cac9bc1->MGS 00000020:01000004:0.0:1790779023.297080:0:14993:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790779023.297085:0:14993:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790779023.297099:0:14993:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ef2331e4d40) 00000020:00000080:0.0:1790779023.297114:0:14993:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790779023.309605:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3438:1877767531617024:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790779023.309682:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779023.316717:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617024 00000100:00100000:2.0:1790779023.316740:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617024 00000100:00100000:2.0:1790779023.316803:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779023.316814:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23d3c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3438:x1877767531617024:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790779023.316861:0:15007:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5971fcd9-bd47-4c7f-984b-89395cac9bc1@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:2.0:1790779023.316904:0:15007:0:(genops.c:1384:class_connect()) connect: client 5971fcd9-bd47-4c7f-984b-89395cac9bc1, cookie 0xdc876326560758e9 00000100:00080000:2.0:1790779023.317088:0:15007:0:(import.c:65:import_set_state_nolock()) ffff9ef2369df800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779023.317199:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23d3c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+5:3438:x1877767531617024:12345-0@lo:250:mount.lustre.0 Request processed in 386us (7517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.317207:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779023.318700:0:3438:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790779023.318721:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:1.0:1790779023.318734:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790779023.318741:0:3438:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790779023.318746:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236c60000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790779023.318750:0:3438:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790779023.318771:0:3438:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790779023.318781:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3438:1877767531617024:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790779023.340156:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779023.342093:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779023.342102:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790779023.358386:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790779023.358618:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790779023.363632:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790779023.363679:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790779023.366175:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779023.366863:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790779023.366869:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790779023.383915:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790779023.383930:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790779023.490057:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779023.491127:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790779023.491138:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790779023.494046:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790779023.494064:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790779023.497820:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779023.498074:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790779023.498081:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790779023.512806:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790779023.512858:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790779023.513885:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779023.514063:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790779023.514068:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790779023.515739:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790779023.515749:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790779023.516397:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779023.516759:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790779023.516765:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790779023.517131:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790779023.517137:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790779023.617508:0:14993:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779023.617741:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790779023.617747:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790779023.629340:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790779023.629360:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790779023.632644:0:14993:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790779023.632684:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790779023.635690:0:14993:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790779023.635734:0:14993:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790779023.635741:0:14993:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790779023.635918:0:14993:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790779023.635974:0:14993:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790779023.635980:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790779023.635983:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790779023.635985:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779023.635987:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779023.635988:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779023.635990:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779023.635992:0:14993:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779023.635994:0:14993:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790779023.635997:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779023.635999:0:14993:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779023.636002:0:14993:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790779023.636004:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779023.636005:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790779023.636007:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779023.636008:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779023.636009:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779023.636016:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779023.636017:0:14993:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779023.636018:0:14993:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790779023.636019:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779023.636020:0:14993:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779023.636054:0:14993:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790779023.636083:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779023.636187:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779023.636274:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef22016d780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.636854:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617152 00000100:00100000:3.0:1790779023.636866:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617152 00000100:00100000:3.0:1790779023.637084:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779023.637096:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23d3cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+5:14993:x1877767531617152:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790779023.637171:0:15009:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790779023.637176:0:15009:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790779023.637179:0:15009:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790779023.638209:0:15030:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790779023.640067:0:15009:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1790779023.647632:0:15031:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790779023.647646:0:15031:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790779023.647649:0:15031:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790779023.647661:0:15031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790779023.648068:0:15009:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790779023.648081:0:15009:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790779023.655923:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23d3cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+5:14993:x1877767531617152:12345-0@lo:253:mount.lustre.0 Request processed in 18818us (19726us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.655942:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779023.656063:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790779023.656081:0:14993:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790779023.656085:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790779023.656087:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790779023.656089:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779023.656090:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779023.656091:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779023.656093:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779023.656095:0:14993:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790779023.656097:0:14993:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790779023.656100:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779023.656101:0:14993:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790779023.656127:0:14993:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef236c63800 from lustre-MDT0000 10000000:01000000:3.0:1790779023.656203:0:14993:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790779023.656206:0:14993:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790779023.656212:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ef2331e0000 10000000:01000000:3.0:1790779023.656217:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790779023.656228:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef2331e0000 from 1 10000000:01000000:3.0:1790779023.656232:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790779023.656290:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.656303:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.656313:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779023.656333:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779023.656372:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779023.656417:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204006b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779023.656528:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617280 00000100:00100000:2.0:1790779023.656536:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617280 00000100:00100000:2.0:1790779023.656576:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779023.656585:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23d3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+5:14993:x1877767531617280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779023.656598:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779023.656615:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de5a00/0xdc876326560758f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560758f0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.656638:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de5a00/0xdc876326560758f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560758f0 expref: 6 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.656649:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de5a00/0xdc876326560758f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560758f0 expref: 6 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.656658:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5a00, rc 0) 00000100:00100000:2.0:1790779023.656695:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23d3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+6:14993:x1877767531617280:12345-0@lo:101:mount.lustre.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.656709:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790779023.656784:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779023.656798:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.656808:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.656877:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.656904:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.656954:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779023.657150:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617408 00000100:00100000:2.0:1790779023.657157:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617408 00000100:00100000:2.0:1790779023.657187:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779023.657193:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+6:14993:x1877767531617408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779023.657277:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+6:14993:x1877767531617408:12345-0@lo:501:mount.lustre.0 Request processed in 84us (372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779023.657284:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790779023.657376:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617408:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790779023.657414:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790779023.657434:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.657475:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779023.657485:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef236c63800 10000000:01000000:1.0:1790779023.657490:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790779023.657493:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ef236c63800 10000000:01000000:1.0:1790779023.657496:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790779023.657499:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ef236c63800 from 1 10000000:01000000:1.0:1790779023.657503:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790779023.657525:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.657533:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.657542:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.657555:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779023.657589:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.657610:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779023.657949:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617536 00000100:00100000:2.0:1790779023.657954:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617536 00000100:00100000:2.0:1790779023.657990:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779023.657998:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+6:14993:x1877767531617536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779023.658007:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779023.658020:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de5600/0xdc87632656075905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560758fe expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.658038:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de5600/0xdc87632656075905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560758fe expref: 7 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.658046:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de5600/0xdc87632656075905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560758fe expref: 7 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.658053:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5600, rc 0) 00000100:00100000:2.0:1790779023.658083:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+7:14993:x1877767531617536:12345-0@lo:101:mount.lustre.0 Request processed in 85us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.658089:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790779023.658207:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779023.658217:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075905 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.658225:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075905 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779023.658247:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790779023.658260:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075905 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.658267:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165ac00/0xdc876326560758fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075905 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779023.658275:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790779023.658279:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779023.658283:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ef236c63800 10000000:01000000:1.0:1790779023.658286:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790779023.658290:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790779023.658292:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790779023.658310:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.658317:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.658324:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.658345:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779023.658372:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.658395:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.658514:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617664 00000100:00100000:3.0:1790779023.658519:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617664 00000100:00100000:3.0:1790779023.658547:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779023.658554:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+7:14993:x1877767531617664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779023.658561:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779023.658572:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014aac00/0xdc87632656075913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607590c expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.658585:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014aac00/0xdc87632656075913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607590c expref: 8 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.658593:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014aac00/0xdc87632656075913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607590c expref: 8 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.658607:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aac00, rc 0) 00000100:00100000:3.0:1790779023.658637:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+8:14993:x1877767531617664:12345-0@lo:101:mount.lustre.0 Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.658643:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790779023.658948:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779023.658961:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075913 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.658968:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075913 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.659016:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.659039:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.659075:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779023.659118:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617792 00000100:00100000:2.0:1790779023.659129:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617792 00000100:00100000:2.0:1790779023.659151:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779023.659158:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+8:14993:x1877767531617792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779023.659334:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:14993:x1877767531617792:12345-0@lo:501:mount.lustre.0 Request processed in 176us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.659341:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779023.659539:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.659567:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779023.659615:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.659635:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.659693:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531617920 00000100:00100000:3.0:1790779023.659698:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531617920 00000100:00100000:3.0:1790779023.659725:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779023.659732:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:14993:x1877767531617920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779023.660651:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:14993:x1877767531617920:12345-0@lo:503:mount.lustre.0 Request processed in 917us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.660662:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790779023.660815:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531617920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779023.661281:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15032:1877767531618048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779023.661338:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779023.661383:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef22016d000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.661555:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531618048 00000100:00100000:3.0:1790779023.661564:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531618048 00000100:00100000:3.0:1790779023.661607:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779023.661616:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:15032:x1877767531618048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779023.662942:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:15032:x1877767531618048:12345-0@lo:502:llog_process_th.0 Request processed in 1323us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.662957:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779023.663060:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15032:1877767531618048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790779023.663092:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779023.663105:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779023.663107:0:15032:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790779023.663114:0:15032:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790779023.663116:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790779023.663136:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ef23b9a4d40) 00000020:00000080:2.0:1790779023.663158:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790779023.663165:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790779023.663284:0:15032:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790779023.663292:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc87632656075921 00000020:00000080:2.0:1790779023.663863:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790779023.663868:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779023.663872:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779023.663874:0:15032:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790779023.663877:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779023.663882:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779023.663884:0:15032:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790779023.663887:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790779023.663897:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ef23b9a0000) 00000020:00000080:2.0:1790779023.663907:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790779023.663919:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790779023.663921:0:15032:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790779023.663924:0:15032:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790779023.663930:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790779023.663985:0:15032:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef236c63800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790779023.664000:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ef23b9a19c0) 00000020:00000080:2.0:1790779023.664007:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790779023.664068:0:15032:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790779023.664074:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656075936 00000020:00000080:2.0:1790779023.664174:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790779023.664181:0:15032:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790779023.664185:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdc8763265607593d 00080000:01000000:2.0:1790779023.664192:0:15032:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790779023.664195:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc87632656075944 00010000:00010000:0.0:1790779023.780056:0:15032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1790779023.780799:0:15032:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1790779023.781322:0:15032:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790779023.782102:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ef2331e19c0) 00000020:00000080:0.0:1790779023.782128:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790779023.782265:0:15032:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790779023.782276:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc87632656075952 00000020:00000080:3.0:1790779023.785744:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790779023.789396:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdc87632656075959 00000020:00000080:1.0:1790779023.798868:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790779023.798885:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779023.798893:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.798895:0:15032:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790779023.798899:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779023.798902:0:15032:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1790779023.798904:0:15032:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779023.798919:0:15032:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779023.798921:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779023.798924:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.798926:0:15032:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779023.798929:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779023.798934:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.798936:0:15032:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790779023.798941:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790779023.798993:0:15032:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790779023.799012:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779023.799016:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.799018:0:15032:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790779023.799020:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790779023.799023:0:15032:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790779023.799027:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.799028:0:15032:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790779023.799031:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790779023.799036:0:15032:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:1.0:1790779023.799062:0:15032:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790779023.799064:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779023.799081:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ef23625b380) 00000020:00000080:1.0:1790779023.799098:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790779023.799103:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790779023.799161:0:15032:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790779023.799169:0:15032:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790779023.799176:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc87632656075967 00010000:00080000:1.0:1790779023.799209:0:15032:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef236261800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1790779023.799627:0:15032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1790779023.800838:0:15032:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790779023.801117:0:15032:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790779023.806404:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779023.806939:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1790779023.818120:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1790779023.820865:0:15036:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790779023.820873:0:15036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790779023.823174:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790779023.823189:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790779023.823306:0:15032:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790779023.823328:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc8763265607596e 00000100:00080000:2.0:1790779023.823339:0:15032:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779023.823351:0:15032:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef236261800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790779023.823387:0:15032:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7d880 x1877767531618176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779023.823498:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531618176:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790779023.823565:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767531618176 offset 0 length 520: 4 00000100:00080000:2.0:1790779023.823941:0:15032:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790779023.824014:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779023.824019:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779023.824022:0:15032:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790779023.824026:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790779023.824029:0:15032:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1790779023.824031:0:15032:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779023.824033:0:15032:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779023.824035:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790779023.824037:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779023.824052:0:15032:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790779023.824056:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790779023.824060:0:15032:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790779023.824064:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779023.824066:0:15032:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790779023.824069:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790779023.824073:0:15032:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:2.0:1790779023.824093:0:15032:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790779023.824096:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790779023.824107:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ef23b9a3380) 00000020:00000080:2.0:1790779023.824122:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790779023.824126:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790779023.824186:0:15032:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790779023.824193:0:15032:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790779023.824200:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdc8763265607597c 00010000:00080000:2.0:1790779023.824242:0:15032:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef214ee2000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1790779023.824495:0:15032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790779023.824572:0:15032:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790779023.824590:0:15032:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790779023.834073:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779023.835028:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790779023.835254:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790779023.838783:0:15038:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790779023.838796:0:15038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790779023.839898:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779023.839911:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790779023.839950:0:15032:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790779023.839971:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656075983 00000100:00080000:1.0:1790779023.839981:0:15032:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779023.839992:0:15032:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef214ee2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1790779023.840031:0:15032:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef23674c380 x1877767531618304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779023.840056:0:15032:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790779023.840102:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779023.840108:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.840109:0:15032:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790779023.840112:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779023.840117:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.840118:0:15032:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790779023.840121:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790779023.840123:0:15032:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790779023.840125:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779023.840128:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.840129:0:15032:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790779023.840131:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779023.840134:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.840136:0:15032:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790779023.840139:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790779023.840173:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15032:1877767531618432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779023.840306:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.840345:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.840485:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531618432 00000100:00100000:3.0:1790779023.840491:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531618432 00000100:00100000:3.0:1790779023.840522:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779023.840534:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:15032:x1877767531618432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779023.840979:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:15032:x1877767531618432:12345-0@lo:502:llog_process_th.0 Request processed in 444us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.840987:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779023.841059:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531618304:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790779023.841080:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767531618304 offset 0 length 520: 4 00000100:00100000:1.0:1790779023.841161:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15032:1877767531618432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790779023.841186:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779023.841191:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779023.841193:0:15032:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790779023.841197:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790779023.841367:0:14993:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1790779023.841383:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790779023.841401:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075913 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.841409:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165a800/0xdc8763265607590c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075913 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779023.841415:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef236c63800 from 1 10000000:01000000:2.0:1790779023.841417:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779023.841438:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.841481:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.841488:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779023.841498:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779023.841520:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779023.841540:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.841971:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531618560 00000100:00100000:3.0:1790779023.841977:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531618560 00000100:00100000:3.0:1790779023.842019:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790779023.842028:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+9:14993:x1877767531618560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779023.842038:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779023.842055:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc8763265607598a expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.842079:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc8763265607598a expref: 10 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.842089:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607598a expref: 10 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779023.842096:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790779023.842130:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+10:14993:x1877767531618560:12345-0@lo:101:mount.lustre.0 Request processed in 103us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.842137:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779023.842220:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779023.842239:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.842246:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.842882:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618688:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790779023.842925:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.842998:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.843346:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531618688 00000100:00100000:3.0:1790779023.843352:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531618688 00000100:00100000:3.0:1790779023.843430:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779023.843439:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+10:14993:x1877767531618688:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790779023.843498:0:15007:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790779023.843505:0:15007:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790779023.843589:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+10:14993:x1877767531618688:12345-0@lo:256:mount.lustre.0 Request processed in 152us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.843596:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779023.843767:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618688:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790779023.844336:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779023.844358:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.844368:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779023.844375:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef236c63800 from 1 10000000:01000000:1.0:1790779023.844378:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779023.844405:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.845733:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.845746:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.845772:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779023.845834:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.846734:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779023.846781:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531618816 00000100:00100000:2.0:1790779023.846790:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531618816 00000100:00100000:0.0:1790779023.846920:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790779023.846932:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+10:14993:x1877767531618816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779023.846946:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779023.846965:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075998 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.846989:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075998 expref: 11 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.847000:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075998 expref: 11 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.847007:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef200030c00, rc 0) 00000100:00100000:0.0:1790779023.847060:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:14993:x1877767531618816:12345-0@lo:101:mount.lustre.0 Request processed in 130us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.847073:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779023.847162:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779023.847176:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.847184:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.847259:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.847286:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.847307:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.847354:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531618944 00000100:00100000:0.0:1790779023.847358:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531618944 00000100:00100000:0.0:1790779023.847375:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779023.847381:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:14993:x1877767531618944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779023.847546:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:14993:x1877767531618944:12345-0@lo:501:mount.lustre.0 Request processed in 164us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.847553:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779023.847814:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531618944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.847856:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779023.847896:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.847917:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2204e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.848005:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619072 00000100:00100000:0.0:1790779023.848010:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619072 00000100:00100000:0.0:1790779023.848029:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790779023.848035:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:14993:x1877767531619072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779023.848119:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:14993:x1877767531619072:12345-0@lo:503:mount.lustre.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.848125:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779023.848207:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779023.848647:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15040:1877767531619200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779023.848683:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.848720:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779023.848785:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619200 00000100:00100000:3.0:1790779023.848790:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619200 00000100:00100000:3.0:1790779023.848815:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779023.848822:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:15040:x1877767531619200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779023.850118:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:15040:x1877767531619200:12345-0@lo:502:llog_process_th.0 Request processed in 1292us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.850128:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779023.850209:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15040:1877767531619200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790779023.850295:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779023.850305:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779023.850308:0:15040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790779023.850318:0:15040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef236c63800 00000020:00000080:0.0:1790779023.850320:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779023.850328:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779023.850330:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779023.850339:0:15040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790779023.850342:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779023.850346:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779023.850347:0:15040:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790779023.850351:0:15040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef236c63800 00000020:00000080:0.0:1790779023.850353:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779023.850484:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779023.850489:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779023.850491:0:15040:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790779023.850494:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779023.850496:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779023.850498:0:15040:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790779023.850501:0:15040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef236c63800 00000020:00000080:0.0:1790779023.850504:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790779023.859399:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15040:1877767531619328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779023.859496:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.871385:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779023.875739:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619328 00000100:00100000:1.0:1790779023.875757:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619328 00000100:00100000:1.0:1790779023.875814:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790779023.875823:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:15040:x1877767531619328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779023.875985:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:15040:x1877767531619328:12345-0@lo:502:llog_process_th.0 Request processed in 164us (16489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.875993:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779023.876121:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15040:1877767531619328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790779023.876153:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779023.876161:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779023.876165:0:15040:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790779023.876172:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790779023.876409:0:14993:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1790779023.876433:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779023.876470:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.876483:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779023.876535:0:14993:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790779023.876657:0:14993:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef236c63800 10000000:01000000:1.0:1790779023.876660:0:14993:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef236c63800 10000000:01000000:1.0:1790779023.876665:0:14993:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779023.876670:0:14993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef236c63800 from 1 10000000:01000000:1.0:1790779023.876673:0:14993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790779023.876701:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.876711:0:14993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.876721:0:14993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.876738:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779023.876780:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.876819:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef22016d300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.876878:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619456 00000100:00100000:0.0:1790779023.876885:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619456 00000100:00100000:0.0:1790779023.876920:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779023.876927:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:14993:x1877767531619456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779023.876937:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779023.876949:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef200031400/0xdc876326560759ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560759a6 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.876981:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef200031400/0xdc876326560759ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560759a6 expref: 12 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.876993:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef200031400/0xdc876326560759ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560759a6 expref: 12 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.877001:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef200031400, rc 0) 00000100:00100000:0.0:1790779023.877031:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531619456:12345-0@lo:101:mount.lustre.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.877038:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790779023.877123:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779023.877134:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759ad expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.877142:0:14993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560759ad expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779023.877185:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.877209:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.883635:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619584 00000100:00100000:0.0:1790779023.883652:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619584 00000100:00100000:0.0:1790779023.883714:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779023.883724:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531619584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779023.883905:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531619584:12345-0@lo:501:mount.lustre.0 Request processed in 183us (6694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.883913:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790779023.884134:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef22016d300 going to sleep for 11 seconds 00000100:00100000:1.0:1790779023.884163:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779023.884221:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779023.884364:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.884395:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef22016d300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779023.884618:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619712 00000100:00100000:0.0:1790779023.884623:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619712 00000100:00100000:0.0:1790779023.885337:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779023.885350:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531619712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779023.885503:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531619712:12345-0@lo:503:mount.lustre.0 Request processed in 157us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.885511:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790779023.885619:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531619712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779023.887399:0:15045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15045:1877767531619840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779023.887487:0:15045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779023.888183:0:15045:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779023.888324:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619840 00000100:00100000:1.0:1790779023.888333:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619840 00000100:00100000:1.0:1790779023.888377:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779023.888387:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15045:x1877767531619840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779023.888668:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15045:x1877767531619840:12345-0@lo:502:llog_process_th.0 Request processed in 281us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.888676:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779023.888771:0:15045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15045:1877767531619840:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790779023.888829:0:15045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790779023.888855:0:15045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ef23b813380) 00000020:00000080:3.0:1790779023.888873:0:15045:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1790779023.888958:0:15045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef236c63800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790779023.888963:0:15045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef236c63800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790779023.888966:0:15045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef236c63800 4 00010000:00080000:3.0:1790779023.888996:0:15045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef2358c0800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1790779023.890637:0:15045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790779023.890794:0:15045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790779023.890826:0:15045:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790779023.890838:0:15045:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdc876326560759bb 00000100:00080000:3.0:1790779023.890866:0:15045:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779023.890883:0:15045:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ef2358c0800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1790779023.890942:0:15045:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2333de300 x1877767531619968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779023.890978:0:15045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790779023.893063:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531619968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790779023.893145:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779023.893347:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531619968 00000100:00100000:1.0:1790779023.893355:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531619968 00000100:00100000:1.0:1790779023.893392:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779023.893406:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531619968:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779023.893627:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3438:x1877767531619968:12345-0@lo:38:llog_process_th.0 Request processed in 219us (481us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790779023.893635:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779023.893730:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779023.893738:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef2358c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779023.893742:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790779023.893745:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531619968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790779023.895405:0:15045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15045:1877767531620096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779023.895494:0:15045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.895541:0:15045:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef208696a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779023.896828:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620096 00000100:00100000:2.0:1790779023.896855:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620096 00000100:00100000:3.0:1790779023.898000:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790779023.898014:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15045:x1877767531620096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779023.898213:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15045:x1877767531620096:12345-0@lo:502:llog_process_th.0 Request processed in 202us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779023.898221:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790779023.902725:0:15045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15045:1877767531620096:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790779023.902766:0:15045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790779023.903494:0:14993:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790779023.903524:0:14993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790779023.903552:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759ad expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.903564:0:14993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165a600/0xdc876326560759a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759ad expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790779023.903629:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790779023.903632:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790779023.903633:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779023.903634:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779023.903635:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779023.903637:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779023.903638:0:14993:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779023.903640:0:14993:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790779023.903642:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779023.903643:0:14993:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779023.903647:0:14993:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790779023.903649:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779023.903650:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790779023.903652:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779023.903653:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779023.903654:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779023.903655:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779023.903656:0:14993:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779023.903662:0:14993:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790779023.903663:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779023.903664:0:14993:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779023.903686:0:14993:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790779023.903704:0:14993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531620224:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779023.903767:0:14993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779023.903804:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620224 00000100:00100000:0.0:1790779023.903811:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620224 00000100:00100000:0.0:1790779023.903862:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779023.903871:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531620224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790779023.903898:0:15007:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790779023.903914:0:15007:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790779023.904063:0:14993:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a4e540 going to sleep for 11 seconds 20000000:01000000:0.0:1790779023.906427:0:15007:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790779023.906476:0:15007:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790779023.906799:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:14993:x1877767531620224:12345-0@lo:253:mount.lustre.0 Request processed in 2923us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779023.906814:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790779023.906968:0:14993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:14993:1877767531620224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790779023.906986:0:14993:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790779023.906990:0:14993:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790779023.906992:0:14993:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790779023.906993:0:14993:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779023.906995:0:14993:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779023.906996:0:14993:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779023.906998:0:14993:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779023.906999:0:14993:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790779023.907001:0:14993:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790779023.907004:0:14993:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779023.907005:0:14993:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790779023.907024:0:14993:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1790779023.910190:0:15030:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790779023.910206:0:15030:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790779023.910242:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.910265:0:15030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc8763265607598a expref: 11 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.910275:0:15030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.910333:0:15030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc8763265607598a expref: 11 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.910349:0:15030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc8763265607598a expref: 11 pid: 15009 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779023.910382:0:15030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15030:1877767531620352:0@lo:104: 00000100:00100000:2.0:1790779023.910476:0:15030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779023.910514:0:15030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2052f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779023.910637:0:14997:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620352 00000100:00100000:1.0:1790779023.910644:0:14997:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620352 00000100:00100000:1.0:1790779023.910682:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779023.910688:0:14997:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15030:x1877767531620352:12345-0@lo:104: 00010000:00010000:1.0:1790779023.910699:0:14997:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779023.910749:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790779023.910753:0:14997:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15030:x1877767531620352:12345-0@lo:104: Request processed in 67us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779023.910758:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779023.910830:0:15030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15030:1877767531620352:0@lo:104: 00010000:00010000:2.0:1790779023.910862:0:15030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.911534:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779023.911542:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.911550:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4e00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790779023.911555:0:15003:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.911564:0:15003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779023.911571:0:15003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779023.911579:0:15003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779023.911621:0:15003:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.911628:0:15003:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779023.911657:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.911679:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235de4e00/0xdc8763265607598a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075991 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.911698:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779023.911700:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779023.911701:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779023.911823:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531620480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779023.911878:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779023.911999:0:14999:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620480 00000100:00100000:2.0:1790779023.912006:0:14999:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620480 00010000:00010000:2.0:1790779023.912027:0:14999:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607598a expref: 12 pid: 15009 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779023.912059:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779023.912068:0:14999:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:3439:x1877767531620480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779023.912078:0:14999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779023.912083:0:14999:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc8763265607598a expref: 12 pid: 15009 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912094:0:14999:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc8763265607598a expref: 12 pid: 15009 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912107:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014abc00/0xdc87632656075991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc8763265607598a expref: 12 pid: 15009 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912121:0:14999:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912129:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779023.912154:0:14999:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001949664s 00010000:00010000:2.0:1790779023.912159:0:14999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912166:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912173:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912180:0:14999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912186:0:14999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779023.912189:0:14999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912199:0:14999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912222:0:14999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779023.912232:0:14999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790779023.912293:0:15030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.912302:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779023.912309:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235de4200/0xdc876326560759c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779023.912387:0:14999:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:3439:x1877767531620480:12345-0@lo:103:ldlm_bl.0 Request processed in 319us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779023.912394:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779023.912483:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531620480:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1790779023.924083:0:14993:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790779023.924524:0:14993:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790779023.924732:0:15050:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1790779023.924735:0:15050:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1790779023.924838:0:15051:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1790779023.925152:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779023.927156:0:15051:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790779023.927240:0:15051:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790779023.927243:0:15051:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1790779023.927826:0:14993:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790779023.927882:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790779023.928313:0:14993:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790779023.928322:0:14993:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790779023.928358:0:14993:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779023.929290:0:14993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790779023.929792:0:14993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790779023.929820:0:14993:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1790779023.933999:0:14993:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1790779023.936043:0:14993:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790779023.937723:0:14993:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790779023.937766:0:14993:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaac181c0f988 00100000:10000000:1.0:1790779023.937786:0:14993:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790779023.938562:0:14993:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790779023.938581:0:14993:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790779023.938605:0:14993:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790779023.938634:0:14993:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1790779023.943210:0:14993:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779023.943481:0:14993:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779024.337947:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790779024.459750:0:15011:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790779024.459763:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef236c63800 from 6 10000000:01000000:0.0:1790779024.459769:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790779024.459848:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779024.459862:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779024.459875:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779024.459907:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531620608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779024.460059:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779024.460139:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20321e000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779024.461506:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620608 00000100:00100000:3.0:1790779024.461524:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620608 00000100:00100000:3.0:1790779024.461590:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790779024.461601:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:15011:x1877767531620608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779024.461630:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779024.461662:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560759c9 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.461693:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560759c9 expref: 12 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.461706:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560759c9 expref: 12 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779024.461716:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014aa400, rc 0) 00000100:00100000:3.0:1790779024.461811:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531620608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779024.461820:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790779024.462910:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531620608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779024.462938:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779024.462950:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779024.463045:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531620736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790779024.463115:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779024.463164:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20321e000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779024.465272:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620736 00000100:00100000:3.0:1790779024.465302:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620736 00000100:00100000:3.0:1790779024.465378:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790779024.465389:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531620736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790779024.465424:0:15009:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790779024.471229:0:15009:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790779024.471260:0:15009:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790779024.471570:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531620736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 6178us (8451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779024.471585:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790779024.473822:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531620736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779024.473906:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779024.473918:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779024.473931:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779024.908294:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779025.356475:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779025.932921:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779026.380879:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779027.412412:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779028.434439:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790779029.008203:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779029.008212:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779029.008215:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779029.008219:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779029.008223:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790779029.008227:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790779029.008231:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ef2358c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779029.008251:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ef2358c0800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1790779029.008274:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef23674d880 x1877767531620992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779029.008321:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531620864:0@lo:400:kworker.0 00000100:00100000:1.0:1790779029.008436:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779029.008575:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531620992:0@lo:38:kworker.0 00000100:00100000:1.0:1790779029.008621:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779029.008658:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620864 00000100:00100000:1.0:1790779029.008668:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620864 00000100:00100000:1.0:1790779029.008726:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779029.008737:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:3440:x1877767531620864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779029.012151:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:3440:x1877767531620864:12345-0@lo:400:kworker.0 Request processed in 3402us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779029.012169:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779029.013113:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531620992 00000100:00100000:1.0:1790779029.013130:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531620992 00000100:00100000:1.0:1790779029.013173:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790779029.013183:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1877767531620992:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790779029.013299:0:15016:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1790779029.013336:0:15016:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdc876326560759d7 00000004:00100000:1.0:1790779029.013354:0:15016:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790779029.013523:0:15016:0:(import.c:65:import_set_state_nolock()) ffff9ef236553000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779029.013616:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3438:x1877767531620992:12345-0@lo:38:kworker.0 Request processed in 434us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779029.013624:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790779029.013765:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef23674d880 x1877767531620992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779029.013784:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790779029.013805:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790779029.013810:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790779029.013822:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef2358c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779029.013829:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3438:1877767531620992:0@lo:38:kworker.0 00000100:00100000:1.0:1790779029.016339:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531620864:0@lo:400:kworker.0 00000001:02000400:1.0:1790779029.067976:0:15294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790779029.451992:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790779030.058615:0:15347:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779030.058814:0:15347:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779030.476715:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790779031.138905:0:15397:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779031.139089:0:15397:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779031.502323:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790779032.357366:0:15445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8dc41750 20000000:00000080:0.0:1790779032.357384:0:15445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef23cad5000 uarg=0000000000000000 20000000:01000000:0.0:1790779032.357429:0:15445:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790779032.357435:0:15445:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790779032.359021:0:15445:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790779032.360311:0:15446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1790779032.360474:0:15445:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790779032.373138:0:15445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790779032.373407:0:15445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.373434:0:15445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075998 expref: 11 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.373462:0:15445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.373510:0:15445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656075998 expref: 11 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.373525:0:15445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656075998 expref: 11 pid: 15008 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779032.373540:0:15445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15445:1877767531621120:0@lo:104: 00000100:00100000:2.0:1790779032.373782:0:15445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779032.373841:0:15445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2126a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779032.374362:0:14998:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531621120 00000100:00100000:0.0:1790779032.374371:0:14998:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531621120 00000100:00100000:0.0:1790779032.374425:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790779032.374457:0:14998:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15445:x1877767531621120:12345-0@lo:104: 00010000:00010000:0.0:1790779032.374476:0:14998:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779032.374538:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790779032.374544:0:14998:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15445:x1877767531621120:12345-0@lo:104: Request processed in 106us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779032.374551:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779032.377153:0:15445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15445:1877767531621120:0@lo:104: 00010000:00010000:2.0:1790779032.377190:0:15445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.379086:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779032.379099:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.379112:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165be00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790779032.379117:0:15002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.379155:0:15002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779032.379165:0:15002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779032.379171:0:15002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779032.379250:0:15002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.379258:0:15002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779032.379293:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.379301:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc8763265607599f expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.379323:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779032.379325:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779032.379327:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779032.379735:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531621248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779032.379829:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779032.380722:0:14999:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531621248 00000100:00100000:2.0:1790779032.380735:0:14999:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531621248 00010000:00010000:2.0:1790779032.380795:0:14999:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075998 expref: 12 pid: 15008 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779032.380837:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779032.380847:0:14999:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:3441:x1877767531621248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779032.381318:0:14999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779032.381327:0:14999:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075998 expref: 12 pid: 15008 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381358:0:14999:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656075998 expref: 12 pid: 15008 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381378:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef200030c00/0xdc8763265607599f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656075998 expref: 12 pid: 15008 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381399:0:14999:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381409:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381428:0:14999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381437:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381479:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381488:0:14999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381495:0:14999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779032.381500:0:14999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381511:0:14999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.381542:0:14999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779032.382026:0:15445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779032.382049:0:15445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.382650:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235de4000/0xdc876326560759de lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779032.382670:0:14999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779032.382774:0:14999:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:3441:x1877767531621248:12345-0@lo:103:ldlm_bl.0 Request processed in 1926us (2942us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779032.382787:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779032.382851:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531621248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779032.526594:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779033.100306:0:3438:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779023/real 1790779023] req@ffff9ef23674c380 x1877767531618304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779033 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.100340:0:3438:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef23674c380 x1877767531618304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779033 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.100404:0:3438:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779023/real 1790779023] req@ffff9ef236b7d880 x1877767531618176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779033 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.100418:0:3438:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef236b7d880 x1877767531618176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779033 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779033.100461:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779033.100479:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779033.100484:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531618304:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790779033.100490:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779033.100496:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779033.100517:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531618176:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790779033.102026:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779033.102034:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790779033.102039:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779033.102047:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1790779033.102054:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790779033.102070:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef236261800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1790779033.102123:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef23674df80 x1877767531621376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779033.102167:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779033.102170:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790779033.102172:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779033.102176:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1790779033.102179:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790779033.102184:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef214ee2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1790779033.102214:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef23674d880 x1877767531621504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779033.102279:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531621632:0@lo:400:kworker.0 00000100:00100000:1.0:1790779033.102362:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779033.102558:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531621376:0@lo:8:kworker.0 00000400:00000100:3.0:1790779033.102595:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767531621376 offset 0 length 520: 4 00000100:00100000:3.0:1790779033.102643:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531621504:0@lo:8:kworker.0 00000400:00000100:3.0:1790779033.102663:0:3438:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767531621504 offset 0 length 520: 4 00000100:00100000:3.0:1790779033.104003:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531621632 00000100:00100000:3.0:1790779033.104016:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531621632 00000100:00100000:3.0:1790779033.104074:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779033.104084:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531621632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779033.104252:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531621632:12345-0@lo:400:kworker.0 Request processed in 169us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779033.104260:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790779033.105359:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef23674ca80 x1877767531621632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779033.109653:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531621632:0@lo:400:kworker.0 00010000:00010000:2.0:1790779033.557948:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790779034.060631:0:15011:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779034.060642:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef236c63800 from 10 10000000:01000000:1.0:1790779034.060648:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779034.060724:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779034.060751:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779034.060766:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779034.060795:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531621760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779034.060889:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779034.060988:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2063823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779034.061110:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531621760 00000100:00100000:3.0:1790779034.061120:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531621760 00000100:00100000:3.0:1790779034.061180:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790779034.061190:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+11:15011:x1877767531621760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779034.061205:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779034.061221:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc876326560759e5 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779034.061248:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc876326560759e5 expref: 12 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779034.061260:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560759e5 expref: 12 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779034.061290:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014abc00, rc 0) 00000100:00100000:3.0:1790779034.061336:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531621760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779034.061342:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790779034.061468:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531621760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779034.061488:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779034.061497:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779034.061581:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531621888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779034.061609:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779034.061636:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779034.061696:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531621888 00000100:00100000:1.0:1790779034.061700:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531621888 00000100:00100000:1.0:1790779034.061734:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790779034.061751:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531621888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779034.061885:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531621888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779034.061892:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790779034.061959:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531621888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779034.061988:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531622016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779034.062029:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779034.062050:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779034.062910:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622016 00000100:00100000:3.0:1790779034.062917:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622016 00000100:00100000:3.0:1790779034.062947:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790779034.062953:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531622016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779034.063081:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15011:x1877767531622016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779034.063089:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790779034.063548:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531622016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790779034.064509:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790779034.064692:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790779034.064716:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779034.064737:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779034.064760:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779034.571609:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779035.149215:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779035.600093:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779036.624368:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779037.643653:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779038.223825:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779038.223833:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779038.223837:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779038.223840:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779038.223886:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531622144:0@lo:400:kworker.0 00000100:00100000:2.0:1790779038.223990:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779038.224087:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779038.224094:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531622272:0@lo:400:kworker.0 00000100:00100000:2.0:1790779038.224129:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779038.225289:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622144 00000100:00100000:2.0:1790779038.225301:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622144 00000100:00100000:2.0:1790779038.225373:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790779038.225383:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:3439:x1877767531622144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779038.225468:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:3439:x1877767531622144:12345-0@lo:400:kworker.0 Request processed in 87us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779038.225476:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790779038.225516:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622272 00000100:00100000:2.0:1790779038.225520:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622272 00000100:00100000:2.0:1790779038.225557:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779038.225564:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531622272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779038.225600:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531622272:12345-0@lo:400:kworker.0 Request processed in 36us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779038.225606:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790779038.225648:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef236b7e300 x1877767531622272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779038.225662:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531622272:0@lo:400:kworker.0 00000100:00100000:2.0:1790779038.225674:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531622144:0@lo:400:kworker.0 00010000:00010000:1.0:1790779038.667640:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779039.694183:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790779040.099958:0:15792:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790779040.099962:0:15792:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1790779040.099963:0:15792:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1790779040.100035:0:15792:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef2201e1800 00000020:01000004:1.0:1790779040.100049:0:15792:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1790779040.100057:0:15792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790779040.100068:0:15792:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ef236258000) 00000020:00000080:1.0:1790779040.100078:0:15792:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790779040.160473:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790779040.169130:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790779040.169677:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790779040.169886:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1790779040.170093:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1790779040.170471:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1790779040.170677:0:15792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1790779040.171674:0:15792:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790779040.171917:0:15792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790779040.171928:0:15792:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790779040.171939:0:15792:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdc876326560759fa 00000020:01000004:0.0:1790779040.171945:0:15792:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790779040.171966:0:15792:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790779040.171969:0:15792:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790779040.171986:0:15792:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790779040.171992:0:15792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790779040.172008:0:15792:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ef2201619c0) 00000020:00000080:0.0:1790779040.172020:0:15792:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1790779040.174906:0:15792:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779040.175106:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790779040.175113:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790779040.180959:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790779040.180971:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790779040.181435:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790779040.181473:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790779040.188600:0:15792:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779040.188822:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790779040.188829:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790779040.189922:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790779040.189933:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790779040.218260:0:15792:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779040.218885:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779040.218893:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790779040.220204:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790779040.220216:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790779040.222115:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790779040.222129:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790779040.228779:0:15792:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779040.228977:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790779040.228985:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790779040.229939:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790779040.229948:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790779040.277017:0:15792:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779040.277248:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790779040.277256:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790779040.278707:0:15792:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790779040.278718:0:15792:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790779040.279157:0:15792:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790779040.279190:0:15792:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1790779040.279197:0:15792:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790779040.290963:0:15792:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790779040.291022:0:15792:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790779040.291028:0:15792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790779040.291031:0:15792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779040.291033:0:15792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779040.291034:0:15792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779040.291035:0:15792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779040.291036:0:15792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779040.291038:0:15792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779040.291040:0:15792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779040.291042:0:15792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779040.291047:0:15792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790779040.291049:0:15792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779040.291051:0:15792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779040.291052:0:15792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779040.291053:0:15792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779040.291054:0:15792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779040.291055:0:15792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779040.291056:0:15792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779040.291057:0:15792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779040.291058:0:15792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779040.291165:0:15792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790779040.291191:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779040.291262:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779040.291391:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205baea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779040.291670:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622400 00000100:00100000:1.0:1790779040.291689:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622400 00000100:00100000:1.0:1790779040.291774:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779040.291785:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15792:x1877767531622400:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790779040.291819:0:15008:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790779040.291823:0:15008:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790779040.291827:0:15008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790779040.292146:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15792:x1877767531622400:12345-0@lo:253:mount.lustre.0 Request processed in 362us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779040.292155:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779040.292253:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779040.292266:0:15792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790779040.292269:0:15792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779040.292271:0:15792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790779040.292273:0:15792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779040.292274:0:15792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779040.292275:0:15792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779040.292277:0:15792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779040.292279:0:15792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779040.292281:0:15792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779040.292282:0:15792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790779040.292314:0:15792:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef2201e1800 from lustre-OST0000 10000000:01000000:0.0:1790779040.292345:0:15792:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790779040.292348:0:15792:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790779040.292356:0:15792:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef2331e0000 local copy 00010000:00010000:0.0:1790779040.292367:0:15792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779040.292522:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779040.292553:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.292999:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.293086:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622528 00000100:00100000:2.0:1790779040.293094:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622528 00000100:00100000:2.0:1790779040.293127:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790779040.293136:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15792:x1877767531622528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779040.293222:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15792:x1877767531622528:12345-0@lo:501:mount.lustre.0 Request processed in 86us (667us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779040.293230:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779040.293360:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622528:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790779040.293374:0:15792:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790779040.293394:0:15792:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790779040.293401:0:15792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.293410:0:15792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779040.293436:0:15792:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef2201e1800 10000000:01000000:0.0:1790779040.293465:0:15792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790779040.293471:0:15792:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ef2331e0000 10000000:01000000:0.0:1790779040.293474:0:15792:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790779040.293478:0:15792:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ef2331e0000 from 1 10000000:01000000:0.0:1790779040.293481:0:15792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790779040.293506:0:15792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.293515:0:15792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.293525:0:15792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779040.293555:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779040.293582:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.293609:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.293747:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622656 00000100:00100000:2.0:1790779040.293753:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622656 00000100:00100000:2.0:1790779040.293774:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790779040.293780:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+12:15792:x1877767531622656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779040.293791:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779040.293806:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de4c00/0xdc87632656075a0f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075a08 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.293826:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4c00/0xdc87632656075a0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075a08 expref: 13 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.293837:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de4c00/0xdc87632656075a0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a08 expref: 13 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.293845:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4c00, rc 0) 00000100:00100000:2.0:1790779040.293885:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+13:15792:x1877767531622656:12345-0@lo:101:mount.lustre.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.293892:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779040.293974:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779040.293986:0:15792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a0f expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.293994:0:15792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075a0f expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779040.294008:0:15792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790779040.294025:0:15792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a0f expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.294032:0:15792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef200030000/0xdc87632656075a08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a0f expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779040.294038:0:15792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790779040.294042:0:15792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790779040.294046:0:15792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790779040.294048:0:15792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790779040.294062:0:15792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.294069:0:15792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.294089:0:15792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779040.294110:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779040.294133:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.294156:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.294257:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622784 00000100:00100000:2.0:1790779040.294262:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622784 00000100:00100000:2.0:1790779040.294279:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790779040.294285:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+13:15792:x1877767531622784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779040.294292:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779040.294300:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de5200/0xdc87632656075a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075a16 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.294313:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de5200/0xdc87632656075a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075a16 expref: 14 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.294321:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de5200/0xdc87632656075a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a16 expref: 14 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.294327:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5200, rc 0) 00000100:00100000:2.0:1790779040.294364:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531622784:12345-0@lo:101:mount.lustre.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.294370:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790779040.294430:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779040.294475:0:15792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a1d expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.294484:0:15792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075a1d expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779040.295902:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790779040.296865:0:15792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779040.298899:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790779040.298957:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790779040.298974:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790779040.298986:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790779040.298998:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790779040.299009:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790779040.299034:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790779040.299040:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790779040.299222:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779040.299301:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.299433:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779040.299735:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531622912 00000100:00100000:3.0:1790779040.299745:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531622912 00000100:00100000:3.0:1790779040.299836:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779040.299847:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531622912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779040.300002:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531622912:12345-0@lo:501:mount.lustre.0 Request processed in 156us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779040.300010:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790779040.300089:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531622912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779040.300124:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779040.300170:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.300320:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779040.300387:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623040 00000100:00100000:1.0:1790779040.300393:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623040 00000100:00100000:1.0:1790779040.300416:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790779040.300423:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779040.301354:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623040:12345-0@lo:503:mount.lustre.0 Request processed in 928us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779040.301365:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790779040.301490:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790779040.301937:0:15792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790779040.302020:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779040.302073:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.302119:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779040.302319:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623168 00000100:00100000:1.0:1790779040.302328:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623168 00000100:00100000:1.0:1790779040.302358:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790779040.302365:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779040.302779:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623168:12345-0@lo:502:mount.lustre.0 Request processed in 413us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779040.302787:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790779040.302997:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779040.303271:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790779040.303306:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790779040.303321:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790779040.303334:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790779040.303346:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790779040.303378:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790779040.303395:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790779040.303408:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790779040.303422:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790779040.303435:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790779040.303471:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790779040.303486:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790779040.303516:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779040.303561:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.303754:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.303864:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623296 00000100:00100000:2.0:1790779040.303872:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623296 00000100:00100000:1.0:1790779040.304012:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790779040.304031:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779040.304270:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623296:12345-0@lo:502:mount.lustre.0 Request processed in 240us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779040.304278:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790779040.304424:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779040.304518:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790779040.304529:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1790779040.305703:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790779040.305714:0:15809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790779040.305721:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.305730:0:15809:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790779040.305737:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779040.305752:0:15809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ef220164d40) 00000020:00000080:0.0:1790779040.305774:0:15809:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790779040.305780:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790779040.305859:0:15809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef2201e1800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790779040.305867:0:15809:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790779040.305873:0:15809:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdc87632656075a2b 00010000:00010000:0.0:1790779040.321145:0:15809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1790779040.321880:0:15809:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1790779040.323745:0:15809:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1790779040.325247:0:15809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790779040.325261:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779040.325268:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.325271:0:15809:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790779040.325274:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790779040.325277:0:15809:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1790779040.325279:0:15809:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779040.325281:0:15809:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779040.325283:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790779040.325285:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.325287:0:15809:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790779040.325290:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779040.325293:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.325295:0:15809:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790779040.325298:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790779040.325301:0:15809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790779040.325304:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779040.325306:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.325307:0:15809:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790779040.325310:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779040.325312:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.325313:0:15809:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790779040.325316:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790779040.325361:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779040.325365:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779040.325366:0:15809:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790779040.325370:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790779040.325619:0:15792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790779040.325652:0:15792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790779040.325691:0:15792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a1d expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.325705:0:15792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef200030c00/0xdc87632656075a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a1d expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779040.325723:0:15792:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef2201e1800 from 1 10000000:01000000:3.0:1790779040.325727:0:15792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779040.325766:0:15792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.325775:0:15792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.325788:0:15792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779040.325815:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779040.325893:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.325935:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef212544480 going to sleep for 11 seconds 00000100:00100000:1.0:1790779040.326177:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623424 00000100:00100000:1.0:1790779040.326187:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623424 00000100:00100000:1.0:1790779040.326240:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779040.326251:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+14:15792:x1877767531623424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779040.326267:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779040.326285:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075a32 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.326313:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075a32 expref: 15 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.326325:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a32 expref: 15 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.326334:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef20165ae00, rc 0) 00000100:00100000:1.0:1790779040.326381:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623424:12345-0@lo:101:mount.lustre.0 Request processed in 132us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779040.326388:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790779040.326722:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779040.326739:0:15792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.326748:0:15792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779040.328042:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790779040.328364:0:15792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779040.328837:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790779040.328864:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790779040.328896:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790779040.328903:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790779040.328966:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779040.329027:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.329129:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2125440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.334196:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623552 00000100:00100000:0.0:1790779040.334212:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623552 00000100:00100000:0.0:1790779040.334269:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790779040.334278:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779040.335869:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623552:12345-0@lo:501:mount.lustre.0 Request processed in 1576us (6825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.335885:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790779040.336755:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779040.336822:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779040.336899:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.336947:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2125440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.337006:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623680 00000100:00100000:0.0:1790779040.337013:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623680 00000100:00100000:0.0:1790779040.337061:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790779040.337070:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779040.337306:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623680:12345-0@lo:503:mount.lustre.0 Request processed in 236us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.337314:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790779040.337393:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790779040.337988:0:15792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790779040.338059:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779040.338251:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.338326:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5480 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.339042:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623808 00000100:00100000:0.0:1790779040.339050:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623808 00000100:00100000:0.0:1790779040.339208:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790779040.339219:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779040.339396:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623808:12345-0@lo:502:mount.lustre.0 Request processed in 178us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.339405:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790779040.339631:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779040.339854:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790779040.339886:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790779040.339902:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790779040.339916:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790779040.339931:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790779040.339944:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790779040.339957:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790779040.339971:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790779040.340004:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779040.340050:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.340105:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.340287:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531623936 00000100:00100000:2.0:1790779040.340292:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531623936 00000100:00100000:2.0:1790779040.340335:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779040.340343:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779040.340429:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531623936:12345-0@lo:502:mount.lustre.0 Request processed in 87us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.340437:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790779040.340603:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531623936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779040.340644:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790779040.340658:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790779040.342225:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779040.342239:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779040.342242:0:15813:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790779040.342249:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef2201e1800 00000020:00000080:1.0:1790779040.342252:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779040.342259:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779040.342261:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779040.342267:0:15813:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790779040.342271:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779040.342274:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779040.342275:0:15813:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790779040.342279:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef2201e1800 00000020:00000080:1.0:1790779040.342280:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779040.342426:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779040.342430:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779040.342432:0:15813:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790779040.342434:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779040.342438:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779040.342465:0:15813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790779040.342471:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef2201e1800 00000020:00000080:1.0:1790779040.342473:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779040.348575:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779040.348601:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779040.348603:0:15813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790779040.348608:0:15813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790779040.350398:0:15792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790779040.350473:0:15792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790779040.362208:0:15792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.362229:0:15792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779040.362383:0:15792:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790779040.362387:0:15792:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef2201e1800 10000000:01000000:2.0:1790779040.362390:0:15792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef2201e1800 10000000:01000000:2.0:1790779040.362394:0:15792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790779040.362401:0:15792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef2201e1800 from 1 10000000:01000000:2.0:1790779040.362404:0:15792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790779040.362476:0:15792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.362486:0:15792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.362498:0:15792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779040.362524:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779040.362589:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779040.363209:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d780 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.363268:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624064 00000100:00100000:0.0:1790779040.363276:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624064 00000100:00100000:0.0:1790779040.363328:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779040.363348:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15792:x1877767531624064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779040.363362:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779040.363375:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef200030200/0xdc87632656075a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075a40 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.363400:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef200030200/0xdc87632656075a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075a40 expref: 16 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.363410:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef200030200/0xdc87632656075a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a40 expref: 16 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779040.363419:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef200030200, rc 0) 00000100:00100000:0.0:1790779040.363517:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624064:12345-0@lo:101:mount.lustre.0 Request processed in 171us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.363524:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779040.363709:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779040.363726:0:15792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a47 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.363735:0:15792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075a47 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779040.365011:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790779040.365354:0:15792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779040.366199:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790779040.366233:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790779040.366258:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790779040.366271:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790779040.366282:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790779040.366296:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790779040.366310:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790779040.366323:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790779040.366336:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790779040.366350:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790779040.366365:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790779040.366377:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790779040.366389:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790779040.366403:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790779040.366417:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790779040.366432:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790779040.367190:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790779040.367210:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790779040.367233:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790779040.367246:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790779040.367258:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790779040.367269:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790779040.367280:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790779040.367295:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790779040.367310:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790779040.367324:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790779040.367339:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790779040.367353:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790779040.367379:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790779040.367392:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790779040.368216:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779040.368297:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779040.368353:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.369171:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624192 00000100:00100000:2.0:1790779040.369180:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624192 00000100:00100000:2.0:1790779040.369269:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790779040.369279:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779040.369408:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624192:12345-0@lo:501:mount.lustre.0 Request processed in 131us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.369416:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790779040.374836:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779040.374906:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779040.374990:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.375103:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.377190:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624320 00000100:00100000:0.0:1790779040.377203:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624320 00000100:00100000:0.0:1790779040.377258:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790779040.377266:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779040.377416:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624320:12345-0@lo:503:mount.lustre.0 Request processed in 150us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.377424:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790779040.377580:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790779040.378036:0:15792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790779040.378130:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779040.378181:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.378227:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.378409:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624448 00000100:00100000:0.0:1790779040.378414:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624448 00000100:00100000:0.0:1790779040.378474:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790779040.378483:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779040.378569:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624448:12345-0@lo:502:mount.lustre.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.378586:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790779040.379376:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779040.379579:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790779040.379823:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790779040.379841:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790779040.379854:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790779040.379868:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790779040.379883:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790779040.379897:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790779040.379930:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790779040.379948:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790779040.379962:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790779040.379977:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790779040.379991:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790779040.380005:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790779040.380021:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790779040.380034:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790779040.380048:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790779040.380063:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790779040.381204:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790779040.381225:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790779040.381238:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790779040.381248:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790779040.381259:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790779040.381270:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790779040.381309:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790779040.381326:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790779040.381340:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790779040.381354:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790779040.381368:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790779040.381382:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790779040.381396:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790779040.381410:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790779040.381424:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790779040.381438:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790779040.381488:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790779040.381501:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790779040.381513:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790779040.381524:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790779040.381534:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790779040.381545:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790779040.381569:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790779040.382989:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779040.384192:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.384999:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.385925:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624576 00000100:00100000:0.0:1790779040.385936:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624576 00000100:00100000:0.0:1790779040.385996:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790779040.386006:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779040.386282:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624576:12345-0@lo:502:mount.lustre.0 Request processed in 277us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.386291:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790779040.386402:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779040.386579:0:15792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790779040.386670:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1790779040.387365:0:15818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790779040.387380:0:15818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ef220163380) 00000020:00000080:0.0:1790779040.387401:0:15818:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1790779040.387998:0:15818:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef2201e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790779040.388004:0:15818:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef2201e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790779040.388006:0:15818:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef2201e1800 3 00010000:00080000:1.0:1790779040.388036:0:15818:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef236607800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1790779040.390237:0:15818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1790779040.390514:0:15818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790779040.390559:0:15818:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790779040.390571:0:15818:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdc87632656075a55 00000100:00080000:1.0:1790779040.390581:0:15818:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779040.390663:0:15818:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ef236607800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1790779040.390717:0:15818:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef23674d500 x1877767531624704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779040.390791:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531624704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790779040.390861:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790779040.390927:0:15818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790779040.394194:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779040.394202:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779040.394205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779040.394209:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790779040.394288:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624704 00000100:00100000:0.0:1790779040.394296:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624704 00000100:00100000:0.0:1790779040.394336:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779040.394343:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1877767531624704:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790779040.394367:0:15016:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1790779040.394410:0:15016:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdc87632656075a5c 00000004:00100000:0.0:1790779040.394426:0:15016:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790779040.394479:0:15016:0:(import.c:65:import_set_state_nolock()) ffff9ef20d3d3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779040.396190:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3438:x1877767531624704:12345-0@lo:38:llog_process_th.0 Request processed in 1838us (5319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.396218:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779040.396269:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531624832:0@lo:400:kworker.0 00000100:00100000:0.0:1790779040.396336:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779040.396396:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624832 00000100:00100000:0.0:1790779040.396405:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624832 00000100:00100000:0.0:1790779040.396464:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779040.396473:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531624832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779040.396527:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531624832:12345-0@lo:400:kworker.0 Request processed in 56us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779040.396533:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790779040.396572:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef2369b8380 x1877767531624832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779040.396588:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531624832:0@lo:400:kworker.0 00010000:00080000:2.0:1790779040.397193:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef23674d500 x1877767531624704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779040.397203:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790779040.397213:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790779040.397221:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790779040.397227:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790779040.397231:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236607800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790779040.397238:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3438:1877767531624704:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790779040.397375:0:15818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1790779040.397913:0:15792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790779040.397943:0:15792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790779040.397966:0:15792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a47 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779040.397977:0:15792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235de4000/0xdc87632656075a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a47 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790779040.398031:0:15792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790779040.398034:0:15792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790779040.398035:0:15792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779040.398036:0:15792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779040.398038:0:15792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779040.398039:0:15792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779040.398040:0:15792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790779040.398043:0:15792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779040.398044:0:15792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790779040.398049:0:15792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1790779040.398052:0:15792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790779040.398054:0:15792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790779040.398055:0:15792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779040.398056:0:15792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779040.398057:0:15792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779040.398058:0:15792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779040.398059:0:15792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790779040.398061:0:15792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779040.398062:0:15792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790779040.398250:0:15792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790779040.398268:0:15792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624960:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790779040.398328:0:15792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779040.398403:0:15792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef236560d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779040.398557:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531624960 00000100:00100000:0.0:1790779040.398565:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531624960 00000100:00100000:0.0:1790779040.399079:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790779040.399091:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790779040.399116:0:15007:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790779040.399129:0:15007:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790779040.405026:0:15007:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790779040.405052:0:15007:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790779040.405339:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15792:x1877767531624960:12345-0@lo:253:mount.lustre.0 Request processed in 6245us (7005us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779040.405352:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 20000000:01000000:3.0:1790779040.405427:0:15030:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790779040.405434:0:15030:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790779040.405479:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.405498:0:15030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560759c9 expref: 15 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.405520:0:15030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.405570:0:15030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560759c9 expref: 15 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779040.405586:0:15030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560759c9 expref: 15 pid: 15008 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779040.405615:0:15030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15030:1877767531625088:0@lo:104: 00000100:00100000:3.0:1790779040.405654:0:15030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779040.405703:0:15030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a600 going to sleep for 11 seconds 00000100:00100000:2.0:1790779040.407247:0:14997:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625088 00000100:00100000:2.0:1790779040.407262:0:14997:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625088 00000100:00100000:2.0:1790779040.407321:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779040.407332:0:14997:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15030:x1877767531625088:12345-0@lo:104: 00010000:00010000:2.0:1790779040.407369:0:14997:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.407486:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779040.407492:0:14997:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15030:x1877767531625088:12345-0@lo:104: Request processed in 163us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.407500:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790779040.407529:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779040.407536:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.407544:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030600 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790779040.407550:0:15003:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.407559:0:15003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779040.407567:0:15003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779040.407574:0:15003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779040.407614:0:15003:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.407620:0:15003:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779040.407644:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.407651:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef200030600/0xdc876326560759c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560759d0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.407689:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779040.407691:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779040.407693:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779040.407733:0:15030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15030:1877767531625088:0@lo:104: 00010000:00010000:2.0:1790779040.407758:0:15030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779040.409802:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3442:1877767531625216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779040.409884:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779040.410060:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625216 00000100:00100000:2.0:1790779040.410079:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625216 00010000:00010000:2.0:1790779040.410120:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560759c9 expref: 16 pid: 15008 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779040.410160:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779040.410169:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3442:x1877767531625216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779040.410185:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779040.410190:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560759c9 expref: 16 pid: 15008 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410202:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560759c9 expref: 16 pid: 15008 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410221:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014aa400/0xdc876326560759d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560759c9 expref: 16 pid: 15008 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410239:0:15000:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410249:0:15000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779040.410281:0:15000:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004847917s 00010000:00010000:2.0:1790779040.410286:0:15000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410294:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410301:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410309:0:15000:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410316:0:15000:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779040.410321:0:15000:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410330:0:15000:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410345:0:15000:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410356:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779040.410396:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:3442:x1877767531625216:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779040.410405:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790779040.410432:0:15030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410472:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779040.410478:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014ab400/0xdc87632656075a63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779040.411162:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3442:1877767531625216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779040.411535:0:15792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15792:1877767531624960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779040.411551:0:15792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790779040.411570:0:15792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779040.411572:0:15792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790779040.411573:0:15792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779040.411574:0:15792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779040.411576:0:15792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779040.411577:0:15792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779040.411579:0:15792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779040.411582:0:15792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779040.411583:0:15792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790779040.411678:0:15792:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1790779040.421186:0:15792:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790779040.423142:0:15792:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790779040.423153:0:15792:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790779040.423190:0:15792:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790779040.423231:0:15792:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790779040.423252:0:15792:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790779040.423267:0:15792:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790779040.426067:0:15792:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779040.426593:0:15792:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779040.721783:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790779041.421198:0:15871:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779041.421402:0:15871:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1790779041.677366:0:15011:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790779041.677377:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef236c63800 from 7 10000000:01000000:1.0:1790779041.677383:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790779041.677480:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.677494:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.677507:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.677539:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531625344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.677620:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.677707:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235c5e840 going to sleep for 11 seconds 00000100:00100000:3.0:1790779041.678399:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625344 00000100:00100000:3.0:1790779041.678410:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625344 00000100:00100000:3.0:1790779041.678503:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790779041.678513:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+15:15011:x1877767531625344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779041.678531:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779041.678549:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075a6a expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.678577:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075a6a expref: 16 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.678589:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a6a expref: 16 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779041.678599:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2014ab200, rc 0) 00000100:00100000:3.0:1790779041.678691:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15011:x1877767531625344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779041.678699:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790779041.680265:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531625344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779041.680864:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.680890:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779041.680980:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531625472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779041.682205:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779041.682323:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235c5e840 going to sleep for 11 seconds 00000100:00100000:2.0:1790779041.687722:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625472 00000100:00100000:2.0:1790779041.687747:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625472 00000100:00100000:0.0:1790779041.688038:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790779041.688048:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15011:x1877767531625472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790779041.688096:0:15007:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790779041.688126:0:15007:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790779041.688129:0:15007:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790779041.688304:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15011:x1877767531625472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 257us (7242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779041.688313:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790779041.688388:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531625472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790779041.688490:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790779041.688502:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779041.688514:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779041.740430:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779042.765605:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779043.787728:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779044.811924:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779045.388094:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779045.835565:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790779045.899643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779045.899652:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779045.899655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779045.899658:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790779045.899735:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531625728:0@lo:400:kworker.0 00000100:00100000:3.0:1790779045.899838:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779045.899909:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779045.899916:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531625600:0@lo:400:kworker.0 00000100:00100000:3.0:1790779045.899947:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779045.899986:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531625856:0@lo:400:kworker.0 00000100:00100000:3.0:1790779045.900013:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779045.900051:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625728 00000100:00100000:3.0:1790779045.900059:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625728 00000100:00100000:3.0:1790779045.900100:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625856 00000100:00100000:3.0:1790779045.900103:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625856 00000100:00100000:3.0:1790779045.900274:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779045.900286:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531625728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779045.900348:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531625728:12345-0@lo:400:kworker.0 Request processed in 64us (509us total) trans 0 rc 0/0 00000100:00080000:2.0:1790779045.900777:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779045.902254:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779045.902281:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531625856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779045.902394:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531625856:12345-0@lo:400:kworker.0 Request processed in 126us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779045.902411:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779045.902963:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625600 00000100:00100000:0.0:1790779045.902972:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625600 00000100:00100000:0.0:1790779045.903017:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790779045.903026:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3440:x1877767531625600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779045.903072:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3440:x1877767531625600:12345-0@lo:400:kworker.0 Request processed in 47us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779045.903079:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790779045.903287:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790779045.903343:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2333dd500 x1877767531625856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779045.903372:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531625856:0@lo:400:kworker.0 00000100:00100000:3.0:1790779045.903408:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531625600:0@lo:400:kworker.0 00010000:00080000:3.0:1790779045.903421:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2333dd180 x1877767531625728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779045.903429:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531625728:0@lo:400:kworker.0 00010000:00010000:2.0:1790779046.873174:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790779047.672118:0:16160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790779047.883583:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779048.589380:0:3438:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779033/real 1790779033] req@ffff9ef23674df80 x1877767531621376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779048.589414:0:3438:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef23674df80 x1877767531621376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779048.589424:0:3438:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779033/real 1790779033] req@ffff9ef23674d880 x1877767531621504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779048.589435:0:3438:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef23674d880 x1877767531621504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790779048.589481:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779048.589666:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790779048.589671:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531621376:0@lo:8:kworker.0 00000100:00080000:3.0:1790779048.589678:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779048.589684:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790779048.589687:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531621504:0@lo:8:kworker.0 00000100:00080000:2.0:1790779048.589820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779048.589825:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790779048.589828:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779048.589832:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:2.0:1790779048.589837:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790779048.589848:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef236261800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790779048.589868:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7ce00 x1877767531626112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779048.589880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779048.589883:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779048.589885:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779048.589889:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:2.0:1790779048.589905:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790779048.589911:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef214ee2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1790779048.589924:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef236b7c380 x1877767531626240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779048.590136:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779048.590151:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531625984:0@lo:400:kworker.0 00000100:00100000:0.0:1790779048.590224:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779048.590297:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531626368:0@lo:400:kworker.0 00000100:00100000:0.0:1790779048.590329:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779048.590350:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790779048.590356:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531626496:0@lo:400:kworker.0 00000100:00100000:0.0:1790779048.590380:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779048.590409:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626368 00000100:00100000:0.0:1790779048.590417:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626368 00000100:00100000:0.0:1790779048.590483:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626496 00000100:00100000:0.0:1790779048.590487:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626496 00000100:00100000:2.0:1790779048.590617:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531625984 00000100:00100000:2.0:1790779048.590622:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531625984 00000100:00100000:2.0:1790779048.590654:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790779048.590662:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3441:x1877767531625984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779048.590716:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3441:x1877767531625984:12345-0@lo:400:kworker.0 Request processed in 54us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779048.590723:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790779048.590923:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779048.590930:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531626368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779048.590968:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531626368:12345-0@lo:400:kworker.0 Request processed in 39us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779048.591257:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779048.591275:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790779048.591293:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531626496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779048.591326:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531626496:12345-0@lo:400:kworker.0 Request processed in 34us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779048.591332:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790779048.591357:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790779048.591383:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef236b7f100 x1877767531626496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779048.591396:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531626496:0@lo:400:kworker.0 00010000:00080000:0.0:1790779048.591407:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef236b7f480 x1877767531626368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779048.591414:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531626368:0@lo:400:kworker.0 00000100:00100000:0.0:1790779048.591479:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531625984:0@lo:400:kworker.0 00000100:00100000:3.0:1790779048.591625:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531626112:0@lo:8:kworker.0 00000100:00100000:3.0:1790779048.591667:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779048.591785:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531626240:0@lo:8:kworker.0 00000100:00100000:3.0:1790779048.591808:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779048.591843:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626112 00000100:00100000:3.0:1790779048.591848:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626112 00000100:00100000:3.0:1790779048.591865:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626240 00000100:00100000:3.0:1790779048.591868:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626240 00000100:00100000:3.0:1790779048.591878:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779048.591883:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3438:x1877767531626112:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790779048.591908:0:15798:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:3.0:1790779048.591943:0:15798:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656075a78 00002000:00100000:3.0:1790779048.591961:0:15798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ef205297800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790779048.591965:0:15798:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790779048.591968:0:15798:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790779048.592377:0:15798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790779048.592404:0:15798:0:(import.c:65:import_set_state_nolock()) ffff9ef205293000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779048.592538:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3438:x1877767531626112:12345-0@lo:8:kworker.0 Request processed in 651us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779048.592546:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779048.592564:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779048.592569:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3438:x1877767531626240:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790779048.592580:0:15798:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790779048.592616:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3438:x1877767531626240:12345-0@lo:8:kworker.0 Request processed in 46us (807us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790779048.592622:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790779048.596061:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef236b7ce00 x1877767531626112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779048.596077:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779048.596088:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790779048.596098:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790779048.596105:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790779048.596109:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef236261800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790779048.597029:0:3438:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790779048.597042:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531626112:0@lo:8:kworker.0 00000100:00080000:0.0:1790779048.597070:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779048.597075:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790779048.597077:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531626240:0@lo:8:kworker.0 00000004:00080000:3.0:1790779048.597335:0:15036:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790779048.597481:0:15036:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442473037464ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790779048.597498:0:15036:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1790779048.602387:0:14994:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790779048.603355:0:15037:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790779048.603386:0:15037:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15037:1877767531626752:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790779048.603480:0:15037:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779048.603519:0:15037:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef220d6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779048.603652:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531626624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779048.603687:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779048.605120:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626624 00000100:00100000:2.0:1790779048.605131:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626624 00000100:00100000:2.0:1790779048.605184:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779048.605192:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531626624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790779048.605218:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923660800 avail 3692138496 00000100:00100000:2.0:1790779048.605276:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531626624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779048.605283:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790779048.605325:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef236b7d180 x1877767531626624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779048.605344:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531626624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790779048.605852:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779048.607341:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626752 00000100:00100000:3.0:1790779048.607354:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626752 00000100:00100000:3.0:1790779048.607406:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779048.607416:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15037:x1877767531626752:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790779048.611105:0:15798:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790779048.611122:0:15798:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790779048.611131:0:15798:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1790779048.624468:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.624482:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624506:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.624511:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.624518:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624538:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624548:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624555:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624577:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.624598:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.624614:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624621:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.624626:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624634:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624776:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624783:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075a7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.624802:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.624804:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.624806:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779048.627155:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.627170:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.627186:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.627191:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.627196:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.627209:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.627219:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.627227:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.627253:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.628079:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.628089:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.628099:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.628104:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.628126:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.628144:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.628151:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075a86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.628171:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.628173:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.628174:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779048.628906:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.628916:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.628927:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.628932:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.628936:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.628959:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.628968:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.628975:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.630048:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779048.630942:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.630954:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.630972:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.630977:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.630982:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.631006:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.631016:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.631039:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.634939:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779048.634957:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.634976:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.634982:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636677:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636704:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636725:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075a8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636750:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.636768:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636775:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.636778:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636786:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636796:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.636803:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.636805:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.636807:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.637721:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790779048.637732:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026744cdb/0xdc87632656075a94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.637842:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779048.639204:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.639217:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.639236:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.639241:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.639247:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.639261:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.639272:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.639279:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.640849:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779048.641523:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.641534:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.641552:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.641557:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.641563:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.641576:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.641586:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.641594:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645031:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779048.645049:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645065:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.645079:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645094:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645125:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645133:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000844dce43/0xdc87632656075a9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645154:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.645159:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645166:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.645170:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645178:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645187:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.645194:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.645203:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.645205:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.648968:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790779048.649046:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009381b0e4/0xdc87632656075aa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779048.649836:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.649846:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.649867:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.649871:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.649877:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.649892:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.649901:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.649909:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.649930:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.650110:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.650120:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.650129:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.650133:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.650142:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.650159:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.650167:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dff4afc6/0xdc87632656075aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.650184:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.650186:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.650188:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.650197:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779048.650855:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779048.650862:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.650871:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1790779048.650875:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779048.650880:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.650889:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.650911:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.650917:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.651645:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790779048.653739:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779048.653762:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.653781:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1790779048.653786:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779048.653793:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.653808:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.653817:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.653827:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656136:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779048.656150:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656163:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.656176:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656187:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656206:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656213:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ac4d9c/0xdc87632656075ab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656235:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.656239:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656246:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.656249:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656256:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656265:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.656271:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.656277:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.656279:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779048.665155:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790779048.665172:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779048.666190:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779048.666201:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.666227:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1790779048.666233:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779048.666240:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.666254:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.666263:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.666270:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.668272:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.668287:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.668301:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.668307:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.668319:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.668344:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.668353:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.668356:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.668358:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779048.669788:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790779048.669807:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9a5e6d/0xdc87632656075abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779048.672988:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779048.673010:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.673030:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1790779048.673035:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779048.673042:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.673072:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.673082:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.673090:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.674653:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.674667:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.674680:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.674685:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.674696:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.674722:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.675387:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.675391:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.675394:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779048.678703:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790779048.678719:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001202f67e/0xdc87632656075ac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779048.679298:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779048.679307:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.679327:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1790779048.679333:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779048.679342:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.679356:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.679380:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.679388:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779048.679504:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779048.682246:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.682259:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.682275:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.682280:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.682286:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.682308:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.682321:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.682328:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682398:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779048.682407:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682427:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.682432:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682469:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682488:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682496:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000793f571a/0xdc87632656075acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682519:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.682523:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682530:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.682534:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682542:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682551:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.682566:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.682567:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.682569:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779048.684129:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.686014:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779048.686029:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e1b5ac/0xdc87632656075ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779048.686750:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.686760:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686777:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.686783:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.686790:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686804:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686828:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686837:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686857:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.686869:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.686874:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686882:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.686887:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686896:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686916:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686924:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf303bf/0xdc87632656075ada lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.686939:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.686946:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.686948:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.687301:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.687379:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.687385:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687393:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.687397:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.687401:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687409:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687417:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687424:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687465:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779048.687731:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.687737:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.687745:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.687749:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.687758:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.687773:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.687780:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b16a6757/0xdc87632656075ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.687794:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.687795:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.687797:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.687872:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.687878:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687887:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.687890:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.687895:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687912:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687922:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687929:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.687953:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779048.688062:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.688068:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688082:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aa400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.688085:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688093:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688104:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688110:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd1de9f/0xdc87632656075ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688124:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.688126:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.688127:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.688399:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.688405:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688413:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.688417:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.688421:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688429:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688436:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688483:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688497:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779048.688716:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.688721:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688729:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014aba00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.688733:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688741:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688759:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688767:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000116a1bfb/0xdc87632656075aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.688780:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.688781:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.688783:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.688840:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.688846:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688855:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.688859:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.688863:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688871:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688880:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.688886:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.689062:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779048.689358:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.689364:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.689379:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.689382:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.689385:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.689393:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.689401:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.689408:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689560:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779048.689566:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689572:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.689577:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689584:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689595:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689612:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c975be7/0xdc87632656075af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689635:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.689639:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689646:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.689649:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689656:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689667:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.689674:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.689675:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.689678:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.690132:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779048.690139:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d551ff2/0xdc87632656075afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779048.694236:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.694248:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.694265:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.694270:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.694277:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.694304:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.694316:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.694324:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.697172:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779048.697186:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.697200:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.697204:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.697227:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.697248:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.697257:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.697259:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779048.697261:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.698198:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779048.698210:0:15798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075b04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.698710:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.698840:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.698848:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.698863:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.698869:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.698876:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.698891:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.698913:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.698921:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.698976:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779048.701327:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.701341:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.701358:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.701362:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.701367:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.701379:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.701389:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.701396:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.703653:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779048.703673:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.703690:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779048.703696:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.703708:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.703735:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779048.703743:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c10a00e8/0xdc87632656075b0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.709816:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.709939:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.709948:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.709963:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.709967:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.709978:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710012:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710020:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071cc236c/0xdc87632656075b12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710039:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.710041:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.710043:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.710798:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.710806:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710820:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.710832:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.710840:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710854:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710864:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710872:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710891:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.710900:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.710905:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710913:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.710916:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710924:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710935:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710952:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0f9dcc/0xdc87632656075b19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.710967:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.710969:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.710970:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.711429:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.711435:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711466:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.711470:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.711474:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711483:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711490:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711498:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711510:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.711518:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.711528:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711535:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.711538:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711546:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711557:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711565:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff1734be/0xdc87632656075b20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711578:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.711579:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.711581:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.711937:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.711943:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711952:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.711955:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.711959:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711980:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.711989:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712056:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712071:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.712079:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.712082:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712153:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.712157:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712165:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712176:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712183:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ebb2072/0xdc87632656075b27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712202:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.712204:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.712206:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.712496:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.712502:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712510:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.712514:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.712519:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712528:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712536:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712543:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712556:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.712562:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.712565:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712581:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.712585:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712592:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712613:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712620:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001846025c/0xdc87632656075b2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.712633:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.712635:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.712637:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779048.713243:0:15798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779048.713250:0:15798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713260:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1790779048.713263:0:15798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779048.713267:0:15798:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713276:0:15798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713290:0:15798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713296:0:15798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713314:0:15798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779048.713324:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779048.713329:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713335:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779048.713339:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713347:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713359:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713367:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9945b09/0xdc87632656075b35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779048.713382:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.713392:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779048.713394:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790779048.713464:0:15798:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1790779048.713583:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15037:x1877767531626752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106164us (110098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779048.713593:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790779048.715929:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779048.716019:0:15037:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15037:1877767531626752:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790779048.716045:0:15037:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790779048.716122:0:15037:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15037:1877767531626880:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790779048.716187:0:15037:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779048.716241:0:15037:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5600 going to sleep for 11 seconds 00000100:00100000:2.0:1790779048.716270:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531626880 00000100:00100000:2.0:1790779048.716277:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531626880 00000100:00100000:2.0:1790779048.716318:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779048.716327:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:15037:x1877767531626880:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790779048.716372:0:15796:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000020:00000004:0.0:1790779048.720083:0:16213:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779048.720403:0:16213:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1790779048.728558:0:15793:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790779048.728621:0:15793:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790779048.728947:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:15037:x1877767531626880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12617us (12757us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790779048.728960:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779048.730419:0:15037:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790779048.730433:0:15037:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15037:1877767531626880:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790779048.730533:0:15037:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1790779048.918326:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790779049.634584:0:16263:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779049.634812:0:16263:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790779049.940433:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779050.956867:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779051.981682:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779053.003676:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779054.030888:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779054.093879:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531627008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779054.093944:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.094018:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627008 00000100:00100000:0.0:1790779054.094025:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627008 00000100:00100000:0.0:1790779054.094073:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790779054.094081:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531627008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779054.094108:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1790779054.094145:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531627008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.094151:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790779054.094170:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779054.094200:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531627008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790779054.103753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779054.103760:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790779054.103765:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779054.103774:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1790779054.103780:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790779054.103794:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef214ee2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1790779054.103820:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2369b9880 x1877767531627264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779054.103886:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531627392:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.103956:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.103992:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779054.103998:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531627136:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.104028:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.104070:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531627264:0@lo:8:kworker.0 00000100:00100000:0.0:1790779054.104097:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.104131:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531627520:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.104152:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779054.104183:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627392 00000100:00100000:0.0:1790779054.104192:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627392 00000100:00100000:0.0:1790779054.104238:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627520 00000100:00100000:0.0:1790779054.104240:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627520 00000100:00100000:0.0:1790779054.104264:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779054.104273:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531627392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.104330:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531627392:12345-0@lo:400:kworker.0 Request processed in 57us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.104348:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779054.104369:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779054.104375:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.104410:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531627520:12345-0@lo:400:kworker.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.104416:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779054.104434:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627136 00000100:00100000:0.0:1790779054.104437:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627136 00000100:00100000:0.0:1790779054.104491:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790779054.104498:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3440:x1877767531627136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.104530:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3440:x1877767531627136:12345-0@lo:400:kworker.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779054.104536:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1790779054.104583:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790779054.104690:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2369b8700 x1877767531627520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779054.104706:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531627520:0@lo:400:kworker.0 00000100:00100000:0.0:1790779054.104737:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531627136:0@lo:400:kworker.0 00010000:00080000:0.0:1790779054.104748:0:3440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2369b9c00 x1877767531627392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779054.104756:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531627392:0@lo:400:kworker.0 00000100:00100000:2.0:1790779054.105749:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627264 00000100:00100000:2.0:1790779054.105758:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627264 00000100:00100000:2.0:1790779054.105799:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779054.105807:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3438:x1877767531627264:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790779054.105828:0:15798:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790779054.140021:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3438:x1877767531627264:12345-0@lo:8:kworker.0 Request processed in 34207us (35916us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790779054.140036:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790779054.140730:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779054.140759:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779054.140767:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531627264:0@lo:8:kworker.0 00010000:00010000:1.0:1790779055.059713:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790779055.632072:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779056.075778:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790779056.713306:0:16608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790779056.713312:0:16608:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790779056.713314:0:16608:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790779056.713872:0:16608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef208c12800 00000020:01000004:3.0:1790779056.713895:0:16608:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790779056.713970:0:16608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790779056.713990:0:16608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ef23b810000) 00000020:00000080:3.0:1790779056.714014:0:16608:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790779056.835063:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790779056.838864:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790779056.839356:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790779056.839598:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790779056.839987:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790779056.840547:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790779056.843153:0:16608:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1790779056.851098:0:16608:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790779056.851348:0:16608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790779056.851364:0:16608:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790779056.851382:0:16608:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdc87632656075b43 00000020:01000004:2.0:1790779056.851393:0:16608:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790779056.851422:0:16608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790779056.851426:0:16608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790779056.851434:0:16608:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790779056.851563:0:16608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790779056.851569:0:16608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790779056.877292:0:16608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790779056.877345:0:16608:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1790779056.877350:0:16608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790779056.877356:0:16608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790779056.877358:0:16608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779056.877360:0:16608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779056.877361:0:16608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779056.877363:0:16608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779056.877365:0:16608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779056.877367:0:16608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779056.877369:0:16608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790779056.877373:0:16608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1790779056.877375:0:16608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779056.877376:0:16608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790779056.877378:0:16608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779056.877379:0:16608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779056.877380:0:16608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779056.877381:0:16608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779056.877383:0:16608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779056.877384:0:16608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779056.877385:0:16608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790779056.877412:0:16608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790779056.877435:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531627648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779056.877635:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779056.877697:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21101bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779056.877865:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627648 00000100:00100000:1.0:1790779056.877875:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627648 00000100:00100000:1.0:1790779056.877944:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790779056.877954:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:16608:x1877767531627648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790779056.877985:0:15008:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790779056.877988:0:15008:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790779056.877992:0:15008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790779056.878547:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:16608:x1877767531627648:12345-0@lo:253:mount.lustre.0 Request processed in 592us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779056.878556:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790779056.878708:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531627648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779056.878720:0:16608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790779056.878723:0:16608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779056.878724:0:16608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790779056.878726:0:16608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779056.878727:0:16608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779056.878729:0:16608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779056.878730:0:16608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779056.878732:0:16608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779056.878734:0:16608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779056.878735:0:16608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790779056.878753:0:16608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef208c12800 from lustre-OST0001 10000000:01000000:0.0:1790779056.878778:0:16608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790779056.878781:0:16608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790779056.878790:0:16608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef2331e0000 local copy 00010000:00010000:0.0:1790779056.878812:0:16608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779056.878909:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531627776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779056.878954:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779056.878993:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21101b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779056.879110:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627776 00000100:00100000:2.0:1790779056.879117:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627776 00000100:00100000:2.0:1790779056.879157:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790779056.879167:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:16608:x1877767531627776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779056.879239:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:16608:x1877767531627776:12345-0@lo:501:mount.lustre.0 Request processed in 73us (284us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779056.879247:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790779056.880630:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531627776:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790779056.880674:0:16608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790779056.880751:0:16608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790779056.880764:0:16608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779056.880775:0:16608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2014abe00/0xdc876326560758f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc876326560758f7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779056.880808:0:16608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef208c12800 10000000:01000000:1.0:1790779056.880814:0:16608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790779056.880824:0:16608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790779056.880830:0:16608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779056.880837:0:16608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790779056.880843:0:16608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790779056.880902:0:16608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779056.880926:0:16608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779056.880937:0:16608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779056.880957:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531627904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779056.881196:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779056.881284:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a600 going to sleep for 11 seconds 00000100:00100000:2.0:1790779056.881405:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531627904 00000100:00100000:2.0:1790779056.881432:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531627904 00000100:00100000:2.0:1790779056.881534:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790779056.881544:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:16608:x1877767531627904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779056.881562:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779056.881582:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de4e00/0xdc87632656075b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075b4a expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.881607:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4e00/0xdc87632656075b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075b4a expref: 17 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.881617:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de4e00/0xdc87632656075b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075b4a expref: 17 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.881625:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4e00, rc 0) 00000100:00100000:2.0:1790779056.881694:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531627904:12345-0@lo:101:mount.lustre.0 Request processed in 149us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779056.881707:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790779056.881980:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531627904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779056.882185:0:16608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b51 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779056.882219:0:16608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075b51 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779056.884627:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790779056.886834:0:16608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779056.892365:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790779056.892420:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790779056.892436:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790779056.894329:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790779056.894359:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790779056.894375:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790779056.894406:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790779056.894411:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790779056.894561:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779056.894633:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779056.896689:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779056.898835:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628032 00000100:00100000:2.0:1790779056.898851:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628032 00000100:00100000:3.0:1790779056.903730:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790779056.903745:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779056.904167:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628032:12345-0@lo:501:mount.lustre.0 Request processed in 424us (9532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779056.904176:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790779056.904314:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779056.904374:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779056.904438:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779056.904577:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235d8a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779056.909275:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628160 00000100:00100000:0.0:1790779056.909296:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628160 00000100:00100000:0.0:1790779056.909414:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790779056.909426:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779056.911817:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628160:12345-0@lo:503:mount.lustre.0 Request processed in 2384us (7370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779056.911831:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790779056.911984:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628160:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790779056.912555:0:16608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779056.912657:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779056.912716:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779056.913734:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779056.913866:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628288 00000100:00100000:2.0:1790779056.913876:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628288 00000100:00100000:2.0:1790779056.913935:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779056.913944:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779056.918310:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628288:12345-0@lo:502:mount.lustre.0 Request processed in 4357us (5584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779056.918326:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790779056.918505:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779056.918763:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790779056.918807:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790779056.918820:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1790779056.918830:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1790779056.918841:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1790779056.918852:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1790779056.918862:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1790779056.918871:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1790779056.918882:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1790779056.918931:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779056.918976:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779056.919009:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b80dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779056.919840:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628416 00000100:00100000:2.0:1790779056.919853:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628416 00000100:00100000:2.0:1790779056.919902:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790779056.919934:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779056.920068:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628416:12345-0@lo:502:mount.lustre.0 Request processed in 136us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779056.920075:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790779056.920402:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779056.920504:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1790779056.920518:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790779056.921311:0:16612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790779056.921320:0:16612:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1790779056.921326:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.921329:0:16612:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790779056.921335:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779056.921350:0:16612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ef2362599c0) 00000020:00000080:1.0:1790779056.921373:0:16612:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790779056.921380:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790779056.922084:0:16612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef208c12800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790779056.922093:0:16612:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790779056.922101:0:16612:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdc87632656075b5f 00010000:00010000:1.0:1790779056.928729:0:16612:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1790779056.930388:0:16612:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1790779056.937033:0:16612:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1790779056.942417:0:16612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790779056.942439:0:16612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779056.942473:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.942476:0:16612:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790779056.942480:0:16612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779056.942484:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.942486:0:16612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790779056.942490:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790779056.942492:0:16612:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790779056.942494:0:16612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779056.942497:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.942498:0:16612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790779056.942501:0:16612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779056.942503:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.942505:0:16612:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790779056.942508:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790779056.942551:0:16612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779056.942555:0:16612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.942556:0:16612:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790779056.942560:0:16612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790779056.943027:0:16608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790779056.943061:0:16608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790779056.943088:0:16608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b51 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.943103:0:16608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef20165b800/0xdc87632656075b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b51 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779056.943112:0:16608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef208c12800 from 1 10000000:01000000:2.0:1790779056.943116:0:16608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790779056.943153:0:16608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.943161:0:16608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.943173:0:16608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779056.943198:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779056.943277:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779056.943331:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779056.943412:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628544 00000100:00100000:3.0:1790779056.943419:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628544 00000100:00100000:3.0:1790779056.943498:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790779056.943518:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:16608:x1877767531628544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779056.943543:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779056.943555:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075b66 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.943580:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075b66 expref: 18 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.943590:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075b66 expref: 18 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.943599:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1400, rc 0) 00000100:00100000:3.0:1790779056.943645:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628544:12345-0@lo:101:mount.lustre.0 Request processed in 129us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779056.943652:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790779056.944049:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779056.944065:0:16608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.944084:0:16608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779056.946704:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790779056.948565:0:16608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779056.948877:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790779056.948926:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790779056.948949:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790779056.948955:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790779056.949075:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779056.949157:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779056.949218:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5900 going to sleep for 11 seconds 00000100:00100000:1.0:1790779056.949556:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628672 00000100:00100000:1.0:1790779056.949565:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628672 00000100:00100000:1.0:1790779056.949621:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790779056.949631:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779056.949770:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628672:12345-0@lo:501:mount.lustre.0 Request processed in 140us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779056.949778:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790779056.957384:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779056.957485:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779056.957605:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779056.957668:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790779056.964906:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628800 00000100:00100000:0.0:1790779056.964939:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628800 00000100:00100000:0.0:1790779056.966544:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790779056.966567:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779056.970104:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628800:12345-0@lo:503:mount.lustre.0 Request processed in 3531us (12482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779056.970125:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790779056.976539:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779056.977626:0:16608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779056.977786:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779056.978121:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779056.978472:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b03480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779056.978683:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531628928 00000100:00100000:3.0:1790779056.978694:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531628928 00000100:00100000:3.0:1790779056.978753:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790779056.978764:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23d3c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779056.978967:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23d3c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531628928:12345-0@lo:502:mount.lustre.0 Request processed in 205us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779056.978985:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790779056.979126:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531628928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779056.979714:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790779056.979783:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790779056.979811:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790779056.979855:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790779056.979871:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790779056.979885:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790779056.980116:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790779056.980134:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790779056.980178:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779056.980255:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779056.980627:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629056 00000100:00100000:0.0:1790779056.980636:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629056 00000100:00100000:0.0:1790779056.980772:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790779056.980782:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23d3cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531629056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779056.984885:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23d3cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531629056:12345-0@lo:502:mount.lustre.0 Request processed in 4092us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779056.984901:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790779056.985139:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2363d5900 going to sleep for 11 seconds 00000100:00100000:3.0:1790779056.985174:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779056.985286:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790779056.985307:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790779056.987336:0:16616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779056.987355:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.987359:0:16616:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790779056.987368:0:16616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef208c12800 00000020:00000080:1.0:1790779056.987372:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779056.987382:0:16616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779056.987403:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.987405:0:16616:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790779056.987408:0:16616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779056.987411:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.987412:0:16616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790779056.987416:0:16616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef208c12800 00000020:00000080:1.0:1790779056.987420:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779056.987533:0:16616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779056.987538:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.987539:0:16616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790779056.987543:0:16616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779056.987545:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.987547:0:16616:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790779056.987551:0:16616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef208c12800 00000020:00000080:1.0:1790779056.987553:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790779056.987578:0:16616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779056.987581:0:16616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779056.987583:0:16616:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790779056.987586:0:16616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790779056.990846:0:16608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790779056.990982:0:16608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790779056.991013:0:16608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.991030:0:16608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779056.991103:0:16608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790779056.991107:0:16608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef208c12800 10000000:01000000:3.0:1790779056.991111:0:16608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef208c12800 10000000:01000000:3.0:1790779056.991116:0:16608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790779056.991137:0:16608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef208c12800 from 1 10000000:01000000:3.0:1790779056.991140:0:16608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790779056.991188:0:16608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.991198:0:16608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.991210:0:16608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779056.991243:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779056.991366:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779056.991436:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21101bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779056.992199:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629184 00000100:00100000:2.0:1790779056.992216:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629184 00000100:00100000:2.0:1790779056.992301:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790779056.992316:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23d3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:16608:x1877767531629184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779056.992339:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779056.992361:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de5e00/0xdc87632656075b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075b74 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.992395:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de5e00/0xdc87632656075b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075b74 expref: 19 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.992410:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de5e00/0xdc87632656075b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075b74 expref: 19 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779056.992430:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5e00, rc 0) 00000100:00100000:2.0:1790779056.992542:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23d3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629184:12345-0@lo:101:mount.lustre.0 Request processed in 229us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779056.992549:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790779056.995863:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779056.995895:0:16608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b7b expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779056.995909:0:16608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075b7b expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779057.017744:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1790779057.018214:0:16608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779057.018617:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790779057.018645:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790779057.018662:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790779057.018677:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790779057.018693:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790779057.018709:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790779057.018724:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790779057.018739:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790779057.018755:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790779057.018791:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790779057.018810:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790779057.018824:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790779057.018850:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790779057.018863:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790779057.018875:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790779057.018888:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790779057.018901:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790779057.025116:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790779057.025185:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790779057.025201:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790779057.025215:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790779057.025228:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790779057.025242:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790779057.025258:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790779057.025272:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1790779057.025318:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1790779057.025336:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1790779057.025349:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1790779057.025363:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1790779057.025378:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1790779057.025394:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1790779057.025411:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1790779057.025424:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1790779057.025437:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1790779057.025484:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1790779057.025500:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1790779057.025513:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1790779057.025556:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1790779057.025563:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1790779057.025690:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779057.025772:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779057.025828:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2332669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779057.025947:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629312 00000100:00100000:0.0:1790779057.025956:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629312 00000100:00100000:0.0:1790779057.026016:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790779057.026026:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779057.026155:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629312:12345-0@lo:501:mount.lustre.0 Request processed in 130us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779057.026163:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790779057.027109:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779057.027186:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779057.027239:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779057.027282:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2332669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779057.027359:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629440 00000100:00100000:0.0:1790779057.027365:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629440 00000100:00100000:0.0:1790779057.027410:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790779057.027419:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779057.027550:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629440:12345-0@lo:503:mount.lustre.0 Request processed in 133us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779057.027559:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790779057.027606:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790779057.028503:0:16608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790779057.028605:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779057.028659:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779057.028701:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21111fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779057.028763:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629568 00000100:00100000:1.0:1790779057.028769:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629568 00000100:00100000:1.0:1790779057.028809:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790779057.028817:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779057.028929:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629568:12345-0@lo:502:mount.lustre.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779057.028937:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790779057.031671:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779057.032076:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790779057.032115:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790779057.032134:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790779057.032150:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790779057.032168:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790779057.032184:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790779057.032199:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790779057.032225:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790779057.032241:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790779057.032256:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790779057.032269:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790779057.032281:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790779057.032295:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790779057.032307:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790779057.032320:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790779057.032333:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790779057.032346:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790779057.032360:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790779057.032375:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790779057.032389:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790779057.032403:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790779057.032417:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790779057.032431:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790779057.032472:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790779057.032493:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1790779057.032508:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1790779057.032533:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1790779057.032550:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1790779057.032564:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1790779057.032579:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1790779057.032593:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1790779057.032606:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1790779057.032620:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1790779057.032635:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1790779057.032649:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1790779057.032662:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1790779057.032673:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1790779057.032685:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1790779057.032697:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1790779057.032712:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1790779057.032764:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779057.032841:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779057.032892:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629696 00000100:00100000:0.0:1790779057.032900:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629696 00000100:00100000:0.0:1790779057.035121:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790779057.035136:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779057.035301:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531629696:12345-0@lo:502:mount.lustre.0 Request processed in 170us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779057.035309:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790779057.035373:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef21111fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790779057.035399:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531629696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779057.035499:0:16608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1790779057.035514:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790779057.040827:0:16621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790779057.040846:0:16621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ef23b8119c0) 00000020:00000080:3.0:1790779057.040869:0:16621:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1790779057.040994:0:16621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef208c12800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790779057.040999:0:16621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef208c12800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790779057.041002:0:16621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef208c12800 3 00010000:00080000:3.0:1790779057.041044:0:16621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef2332db000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1790779057.046052:0:16621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1790779057.048573:0:16621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790779057.048643:0:16621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790779057.048658:0:16621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdc87632656075b89 00000100:00080000:3.0:1790779057.048670:0:16621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779057.048683:0:16621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ef2332db000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1790779057.048727:0:16621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2333dca80 x1877767531629824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779057.048768:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531629824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779057.048836:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779057.048900:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629824 00000100:00100000:3.0:1790779057.048907:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629824 00000100:00100000:3.0:1790779057.048953:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779057.048960:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3438:x1877767531629824:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779057.048983:0:15016:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1790779057.049015:0:15016:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdc87632656075b90 00000004:00100000:3.0:1790779057.049030:0:15016:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779057.049062:0:15016:0:(import.c:65:import_set_state_nolock()) ffff9ef2332dc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779057.049271:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3438:x1877767531629824:12345-0@lo:38:llog_process_th.0 Request processed in 309us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779057.049279:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790779057.049317:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2333dca80 x1877767531629824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779057.049326:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779057.049333:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1790779057.049340:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790779057.049343:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790779057.049346:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef2332db000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790779057.049362:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3438:1877767531629824:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790779057.049380:0:16621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790779057.049425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779057.049429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790779057.049432:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779057.049436:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1790779057.049439:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790779057.049468:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef214ee2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1790779057.049482:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2333dc700 x1877767531630080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779057.049541:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531629952:0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.049575:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779057.049612:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531630080:0@lo:8:kworker.0 00000100:00100000:3.0:1790779057.049634:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779057.049660:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531630208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.049683:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779057.049703:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779057.049708:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531630336:0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.049729:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779057.049759:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531629952 00000100:00100000:3.0:1790779057.049763:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531629952 00000100:00100000:3.0:1790779057.049818:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630080 00000100:00100000:3.0:1790779057.049822:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630080 00000100:00100000:3.0:1790779057.052057:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779057.052077:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531629952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.052213:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531629952:12345-0@lo:400:kworker.0 Request processed in 147us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779057.052222:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779057.052241:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779057.052245:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3438:x1877767531630080:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1790779057.052300:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3438:x1877767531630080:12345-0@lo:8:kworker.0 Request processed in 52us (2664us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790779057.052307:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779057.052335:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630208 00000100:00100000:3.0:1790779057.052343:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630208 00000100:00100000:3.0:1790779057.052380:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630336 00000100:00100000:3.0:1790779057.052384:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630336 00000100:00100000:3.0:1790779057.052407:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779057.052415:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531630208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.052470:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3439:x1877767531630208:12345-0@lo:400:kworker.0 Request processed in 57us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779057.052476:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779057.052487:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790779057.052493:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531630336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.052533:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531630336:12345-0@lo:400:kworker.0 Request processed in 41us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779057.052540:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790779057.052561:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779057.052567:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779057.052737:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531629952:0@lo:400:kworker.0 00000100:00100000:3.0:1790779057.052779:0:3438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779057.052796:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779057.052801:0:3438:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790779057.052804:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531630080:0@lo:8:kworker.0 00010000:00080000:3.0:1790779057.052844:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2333de680 x1877767531630336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779057.052854:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531630336:0@lo:400:kworker.0 00010000:00080000:3.0:1790779057.052867:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef2333dd500 x1877767531630208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779057.052875:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3439:1877767531630208:0@lo:400:kworker.0 00000040:00080000:3.0:1790779057.054097:0:16621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1790779057.054269:0:16608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790779057.054308:0:16608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790779057.054338:0:16608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b7b expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779057.054351:0:16608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef2358a0a00/0xdc87632656075b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075b7b expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790779057.054407:0:16608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790779057.054409:0:16608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790779057.054411:0:16608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779057.054412:0:16608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779057.054414:0:16608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779057.054416:0:16608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779057.054418:0:16608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779057.054420:0:16608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779057.054422:0:16608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779057.054431:0:16608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790779057.054433:0:16608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779057.054435:0:16608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790779057.054436:0:16608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779057.054437:0:16608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779057.054438:0:16608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779057.054482:0:16608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779057.054483:0:16608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779057.054484:0:16608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779057.054485:0:16608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779057.054517:0:16608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790779057.054552:0:16608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531630464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779057.054630:0:16608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779057.054681:0:16608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef204ff2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779057.054766:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630464 00000100:00100000:3.0:1790779057.054773:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630464 00000100:00100000:3.0:1790779057.054818:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790779057.054829:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531630464:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790779057.054859:0:15007:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790779057.054876:0:15007:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790779057.058304:0:15007:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790779057.058327:0:15007:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790779057.058547:0:15030:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790779057.058552:0:15030:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790779057.058574:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.058592:0:15030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a6a expref: 19 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.058602:0:15030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.058642:0:15030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656075a6a expref: 19 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.058657:0:15030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656075a6a expref: 19 pid: 15009 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779057.058671:0:15030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15030:1877767531630592:0@lo:104: 00000100:00100000:2.0:1790779057.058739:0:15030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779057.058789:0:15030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20510e180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779057.058845:0:14998:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630592 00000100:00100000:1.0:1790779057.058855:0:14998:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630592 00000100:00100000:1.0:1790779057.058905:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790779057.058924:0:14998:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15030:x1877767531630592:12345-0@lo:104: 00010000:00010000:1.0:1790779057.058936:0:14998:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779057.058998:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790779057.059005:0:14998:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:15030:x1877767531630592:12345-0@lo:104: Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779057.059011:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1790779057.059034:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779057.059040:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779057.059047:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165be00 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790779057.059051:0:15002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779057.059074:0:15002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779057.059082:0:15002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779057.059087:0:15002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790779057.059117:0:15002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779057.059124:0:15002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779057.059142:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779057.059149:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165be00/0xdc87632656075a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075a71 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779057.059167:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779057.059169:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779057.059170:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779057.059301:0:15030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15030:1877767531630592:0@lo:104: 00010000:00010000:0.0:1790779057.059316:0:15030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779057.059410:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531630720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779057.059436:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779057.059585:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:16608:x1877767531630464:12345-0@lo:253:mount.lustre.0 Request processed in 4758us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779057.059594:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790779057.059880:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630720 00000100:00100000:2.0:1790779057.059886:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630720 00010000:00010000:2.0:1790779057.059983:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075a6a expref: 20 pid: 15009 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779057.060033:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779057.060042:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+20:3441:x1877767531630720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779057.060054:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779057.060059:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075a6a expref: 20 pid: 15009 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060069:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656075a6a expref: 20 pid: 15009 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060082:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014ab200/0xdc87632656075a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656075a6a expref: 20 pid: 15009 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060094:0:15000:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060102:0:15000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779057.060115:0:15000:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004847917s 00010000:00010000:2.0:1790779057.060120:0:15000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060126:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060133:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060140:0:15000:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060151:0:15000:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779057.060155:0:15000:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060163:0:15000:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060175:0:15000:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779057.060186:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779057.060215:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3441:x1877767531630720:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779057.060222:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779057.060388:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531630720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779057.060603:0:15030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779057.060612:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779057.060618:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef235de4a00/0xdc87632656075b97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779057.060652:0:16608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5971fcd9-bd47-4c7f-984b-89395cac9bc1:16608:1877767531630464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790779057.060661:0:16608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790779057.060664:0:16608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790779057.060673:0:16608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790779057.060675:0:16608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779057.060676:0:16608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779057.060677:0:16608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779057.060679:0:16608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779057.060681:0:16608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779057.060683:0:16608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779057.060685:0:16608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790779057.060695:0:16608:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1790779057.066768:0:16608:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790779057.068589:0:16608:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790779057.068599:0:16608:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790779057.068644:0:16608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790779057.068701:0:16608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790779057.068725:0:16608:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790779057.068756:0:16608:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790779057.069568:0:16608:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779057.069813:0:16608:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790779057.102299:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790779058.033173:0:16672:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779058.033431:0:16672:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779058.123671:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790779058.316536:0:15011:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790779058.316548:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef236c63800 from 8 10000000:01000000:2.0:1790779058.316554:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779058.316612:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779058.316626:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779058.316658:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779058.316689:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531630848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779058.316766:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779058.316830:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205b030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779058.317253:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630848 00000100:00100000:0.0:1790779058.317264:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630848 00000100:00100000:0.0:1790779058.319541:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790779058.319567:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531630848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779058.319591:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779058.319617:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef200031c00/0xdc87632656075ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075b9e expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779058.319649:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef200031c00/0xdc87632656075ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075b9e expref: 19 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779058.319661:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef200031c00/0xdc87632656075ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075b9e expref: 19 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779058.319670:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef200031c00, rc 0) 00000100:00100000:0.0:1790779058.319757:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531630848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779058.319765:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790779058.319891:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531630848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779058.319925:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075ba5 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779058.319934:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075ba5 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779058.320025:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531630976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790779058.320068:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779058.327190:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779058.330764:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531630976 00000100:00100000:1.0:1790779058.330780:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531630976 00000100:00100000:1.0:1790779058.330843:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790779058.330854:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531630976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790779058.330882:0:15009:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790779058.330925:0:15009:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790779058.330929:0:15009:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1790779058.331068:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531630976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 216us (10999us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779058.331077:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790779058.331245:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531630976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790779058.331310:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790779058.331320:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075ba5 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779058.331330:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235de4600/0xdc87632656075b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075ba5 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779059.152036:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779059.212074:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779059.212108:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531631104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779059.212182:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779059.215881:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631104 00000100:00100000:2.0:1790779059.215898:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631104 00000100:00100000:2.0:1790779059.216016:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779059.216028:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531631104:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779059.216049:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790779059.216064:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:2.0:1790779059.216161:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531631104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779059.216169:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779059.216266:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531631104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790779060.172049:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779061.199307:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.223804:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790779062.286730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779062.286738:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790779062.286743:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779062.286761:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef214ee2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1790779062.286782:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef2333dca80 x1877767531631488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779062.286850:0:3438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531631488:0@lo:8:kworker.0 00000100:00100000:3.0:1790779062.286911:0:3438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779062.286991:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531631616:0@lo:400:kworker.0 00000100:00100000:3.0:1790779062.287017:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779062.287048:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779062.287054:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531631744:0@lo:400:kworker.0 00000100:00100000:3.0:1790779062.287071:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779062.287100:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631488 00000100:00100000:3.0:1790779062.287107:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631488 00000100:00100000:3.0:1790779062.287137:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779062.287144:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3438:x1877767531631488:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790779062.287171:0:15799:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:3.0:1790779062.287195:0:15799:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdc87632656075bac 00002000:00100000:3.0:1790779062.287207:0:15799:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ef2332da000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790779062.287212:0:15799:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790779062.287215:0:15799:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790779062.287392:0:15799:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790779062.287415:0:15799:0:(import.c:65:import_set_state_nolock()) ffff9ef2332dc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779062.287513:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3438:x1877767531631488:12345-0@lo:8:kworker.0 Request processed in 368us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779062.287520:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779062.287541:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631616 00000100:00100000:3.0:1790779062.287544:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631616 00000100:00100000:3.0:1790779062.287565:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631744 00000100:00100000:3.0:1790779062.287568:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631744 00000100:00100000:3.0:1790779062.287588:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779062.287594:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531631616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779062.287627:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3441:x1877767531631616:12345-0@lo:400:kworker.0 Request processed in 33us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779062.287633:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779062.287643:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779062.287648:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531631744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779062.287690:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3441:x1877767531631744:12345-0@lo:400:kworker.0 Request processed in 42us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779062.287696:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790779062.287732:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790779062.287755:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333dce00 x1877767531631744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779062.287769:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3441:1877767531631744:0@lo:400:kworker.0 00010000:00080000:3.0:1790779062.287778:0:3441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333ded80 x1877767531631616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779062.287785:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3441:1877767531631616:0@lo:400:kworker.0 00010000:00080000:3.0:1790779062.287810:0:3438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333dca80 x1877767531631488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790779062.287819:0:3438:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790779062.287826:0:3438:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790779062.287830:0:3438:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790779062.287833:0:3438:0:(import.c:65:import_set_state_nolock()) ffff9ef214ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790779062.287852:0:3438:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790779062.287857:0:3438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3438:1877767531631488:0@lo:8:kworker.0 00000004:00080000:3.0:1790779062.287885:0:15039:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1790779062.287898:0:15039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15039:1877767531632128:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790779062.287920:0:15039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779062.287933:0:15039:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef206bea600 going to sleep for 11 seconds 00000100:00100000:3.0:1790779062.287944:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632128 00000100:00100000:3.0:1790779062.287947:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632128 00000100:00100000:3.0:1790779062.287974:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779062.287979:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:15039:x1877767531632128:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1790779062.288164:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790779062.288195:0:15038:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790779062.288255:0:15038:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 456163812550ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790779062.288261:0:15038:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1790779062.288490:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531631232:0@lo:400:kworker.0 00000100:00100000:0.0:1790779062.288529:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779062.288557:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531631872:0@lo:400:kworker.0 00000100:00100000:0.0:1790779062.288579:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779062.288597:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790779062.288603:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531631360:0@lo:400:kworker.0 00000100:00100000:0.0:1790779062.288621:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779062.288632:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779062.288648:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779062.288672:0:15801:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632000 00000100:00100000:0.0:1790779062.288676:0:15801:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632000 00000100:00100000:0.0:1790779062.288698:0:15801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790779062.288704:0:15801:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531632000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779062.288722:0:15801:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790779062.288757:0:15801:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3439:x1877767531632000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779062.288762:0:15801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790779062.288789:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2365ca680 x1877767531632000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779062.288803:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779062.288819:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631872 00000100:00100000:0.0:1790779062.288822:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631872 00000100:00100000:0.0:1790779062.288846:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779062.288852:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531631872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779062.288888:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531631872:12345-0@lo:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779062.288894:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1790779062.288910:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790779062.288923:0:3439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef2333dfb80 x1877767531631872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779062.288931:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531631872:0@lo:400:kworker.0 00000100:00100000:3.0:1790779062.289201:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631232 00000100:00100000:3.0:1790779062.289206:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631232 00000100:00100000:3.0:1790779062.289233:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790779062.289239:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3439:x1877767531631232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779062.289272:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3439:x1877767531631232:12345-0@lo:400:kworker.0 Request processed in 34us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779062.289278:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790779062.289301:0:15798:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790779062.289308:0:15798:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790779062.294278:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531631360 00000100:00100000:2.0:1790779062.294291:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531631360 00000100:00100000:2.0:1790779062.294354:0:15798:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790779062.294370:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779062.294380:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531631360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779062.294528:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531631360:12345-0@lo:400:kworker.0 Request processed in 148us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779062.294536:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790779062.294560:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779062.294860:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531631360:0@lo:400:kworker.0 00000100:00100000:0.0:1790779062.294874:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531631232:0@lo:400:kworker.0 00002000:00080000:3.0:1790779062.301242:0:15796:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790779062.301259:0:15796:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790779062.301266:0:15796:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:0.0:1790779062.313237:0:14994:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1790779062.315387:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.315403:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.315423:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.315428:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.315436:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.315495:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.315507:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.315535:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.315552:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.315595:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.315605:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.315816:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200030600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.315821:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.315833:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.315865:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.315874:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c9a5e6d/0xdc87632656075bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.315897:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.315899:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.315901:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.316061:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.316068:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316077:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.316081:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.316085:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316094:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316102:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316109:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316127:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779062.316607:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779062.316615:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.316639:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef200031e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779062.316643:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.316653:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.316668:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.316676:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000793f571a/0xdc87632656075bba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.316696:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.316698:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.316699:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.316801:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.316808:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316822:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.316826:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.316830:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316840:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316847:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316855:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.316881:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.316966:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.316974:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.316983:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.316986:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.316995:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.317006:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.317013:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b8a5a5/0xdc87632656075bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.317038:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.317039:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.317041:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.317522:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.317530:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.317541:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.317545:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.317550:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.317561:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.317582:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.317590:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.317607:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790779062.317948:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.317954:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.317963:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.317966:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.317970:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.318074:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.318085:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.318092:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.318123:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779062.318351:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779062.318360:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318376:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.318381:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318391:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318404:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318413:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd2da4b7/0xdc87632656075bc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318431:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.318435:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318464:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.318484:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318492:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318503:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318510:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044ac8f55/0xdc87632656075bcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.318525:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.318528:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.318530:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.321767:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.321785:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.321807:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.321812:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.321819:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.321834:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.321846:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.321855:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.321970:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.322046:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.322059:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.322073:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.322079:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.322091:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.322109:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.322125:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b994d329/0xdc87632656075bd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.322154:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.322157:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.322159:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.322492:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.323136:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.323145:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323159:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.323172:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.323179:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323191:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323201:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323210:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323231:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.323410:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.323418:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323427:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.323431:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323456:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323484:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323492:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad9902e8/0xdc87632656075bdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323513:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.323515:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.323517:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.323619:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.323626:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323636:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.323639:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.323643:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323653:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323661:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323676:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.323704:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.323724:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.323731:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323740:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.323743:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323753:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323765:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323773:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ef0232c/0xdc87632656075be4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.323788:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.323790:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.323791:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.324170:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.324177:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.324187:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.324190:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.324195:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.324204:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.324214:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.324222:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.324244:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.324299:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.324306:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.324314:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.324318:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.324339:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.324351:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.324359:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3211d37/0xdc87632656075beb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.324373:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.324375:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.324377:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.327770:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.327787:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.327826:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.327831:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.327837:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.327850:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.328015:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.328024:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.328052:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.328134:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.328144:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.328154:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.328159:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.328171:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.328191:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.328212:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5ba8a25/0xdc87632656075bf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.328235:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.328237:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.328239:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.333039:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.333055:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333072:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.333077:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.333084:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333097:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333120:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333128:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333154:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.333181:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.333191:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333203:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.333208:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333221:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333243:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333252:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057aa775b/0xdc87632656075bf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333287:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.333289:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.333291:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.333730:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.333737:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333746:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.333750:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.333754:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333764:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333771:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333778:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.333814:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.333848:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.333855:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333864:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.333869:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333879:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333892:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333900:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a0675bc/0xdc87632656075c00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.333916:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.333918:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.333920:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.337937:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.337952:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.337971:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.337976:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.337991:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338006:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338016:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338024:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338049:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.338073:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.338082:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338092:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.338098:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338129:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338148:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338157:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000874a6b8e/0xdc87632656075c07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338181:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.338183:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.338185:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.338768:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.338776:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338787:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.338798:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.338803:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338814:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338823:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338830:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.338854:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.338875:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.338882:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338891:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.338896:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338905:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338917:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338936:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dae1945/0xdc87632656075c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.338951:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.338953:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.338955:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.339228:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.339235:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339245:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.339249:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.339254:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339264:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339274:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339288:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339312:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.339492:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.339499:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.339507:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.339511:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.339520:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.339532:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.339539:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbaf5adf/0xdc87632656075c15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.339565:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.339567:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.339568:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.339670:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.339676:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339686:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.339689:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.339694:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339705:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339714:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339722:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.339744:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790779062.340041:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.340047:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.340062:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.340065:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.340069:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.340078:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.340086:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.340093:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.340197:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779062.348021:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779062.348044:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348062:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.348067:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348081:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348106:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348113:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7912310/0xdc87632656075c1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348146:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.348149:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348155:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.348159:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348165:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348193:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348200:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.348213:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.348215:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.348217:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790779062.349641:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.349655:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.349671:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.349676:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.349683:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.349700:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.349710:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.349717:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.349731:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779062.350109:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779062.350118:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.350128:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165be00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779062.350133:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.350155:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.350171:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.350179:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa208bbb/0xdc87632656075c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.350288:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.350291:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.350293:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790779062.351129:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.351138:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.351158:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.351162:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.351168:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.351181:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.351191:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.351200:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.351227:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.351354:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.351362:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.351372:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165a000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.351377:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.351388:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.351402:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.351421:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037f91792/0xdc87632656075c31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.351457:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.351459:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.351461:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790779062.353084:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.353096:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.353111:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.353116:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.353122:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.353135:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.353159:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.353168:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.353197:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.353501:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.353509:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.353519:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.353525:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.353535:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.353550:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.353558:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005db30120/0xdc87632656075c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.353576:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.353578:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.353580:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790779062.354158:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.354167:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.354177:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.354181:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.354186:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.354196:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.354205:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.354212:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.354247:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.354353:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.354360:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.354368:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.354373:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.354382:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.354393:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.354400:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f5ec5b/0xdc87632656075c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.354414:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.354416:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.354417:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790779062.355144:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.355152:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.355162:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.355166:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.355170:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.355178:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.355186:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.355192:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.355216:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779062.355728:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.355735:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.355744:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386000 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.355749:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.355771:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.355784:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.355791:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000110224d5/0xdc87632656075c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.355808:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.355810:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.355812:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790779062.356555:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.356565:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.356577:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.356588:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.356594:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.356606:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.356616:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.356623:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.358127:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790779062.360760:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.360776:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.360795:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.360800:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.360807:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.360821:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.360831:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.360855:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363193:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779062.363211:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363227:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.363235:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363248:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363275:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363301:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d6a28b8/0xdc87632656075c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363336:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779062.363339:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363346:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779062.363349:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363356:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363367:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779062.363374:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.363376:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779062.363378:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779062.365522:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790779062.365537:0:15796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.365637:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.366292:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.366301:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.366316:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.366321:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.366327:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.366341:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.366361:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.366369:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.366393:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779062.366684:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779062.366691:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.366700:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13600 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779062.366705:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.366714:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.366732:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.366740:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007da5c4d7/0xdc87632656075c5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.366763:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.366765:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.366767:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779062.367154:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.367161:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.367170:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1790779062.367173:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779062.367178:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.367187:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.367195:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.367203:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.368029:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790779062.376709:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779062.376722:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.376742:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.376747:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.376754:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.376771:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.376784:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.376794:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377502:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779062.377512:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377521:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779062.377526:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377535:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377552:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377559:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013bf65ec/0xdc87632656075c62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377584:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779062.377588:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377594:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386200 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779062.377606:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377613:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377623:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779062.377630:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.377632:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779062.377633:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779062.380125:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790779062.380140:0:15796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004469c463/0xdc87632656075c69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790779062.381863:0:15796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779062.382034:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779062.382043:0:15796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.382061:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1790779062.382066:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779062.382073:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.382087:0:15796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.382098:0:15796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.382107:0:15796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779062.382152:0:15796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1790779062.382225:0:15796:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1790779062.382331:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:15039:x1877767531632128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94347us (94406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779062.382351:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790779062.382377:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779062.382384:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.382393:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387a00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790779062.382398:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.382408:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.382426:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.382433:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ed237b/0xdc87632656075c70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779062.382484:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779062.382486:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779062.382488:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779062.383600:0:15039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15039:1877767531632128:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790779062.383622:0:15039:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1790779062.383674:0:15039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15039:1877767531632256:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790779062.383740:0:15039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779062.383798:0:15039:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef20510ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779062.383890:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632256 00000100:00100000:2.0:1790779062.383898:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632256 00000100:00100000:2.0:1790779062.383955:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779062.383966:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15039:x1877767531632256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790779062.384173:0:15798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1790779062.396977:0:16609:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1790779062.397042:0:16609:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790779062.400089:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:15039:x1877767531632256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16113us (16337us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790779062.400107:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779062.406315:0:15039:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790779062.406331:0:15039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15039:1877767531632256:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790779062.406350:0:15039:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:02000400:0.0:1790779063.063346:0:16963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790779063.243558:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790779064.181743:0:17015:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779064.182608:0:17015:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779064.267911:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779064.334983:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531632384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779064.335072:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779064.335188:0:15801:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632384 00000100:00100000:1.0:1790779064.335197:0:15801:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632384 00000100:00100000:1.0:1790779064.335251:0:15801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790779064.335262:0:15801:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531632384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779064.335297:0:15801:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00080000:2.0:1790779064.335385:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779064.338767:0:15801:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531632384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3407us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779064.338795:0:15801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779064.339020:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531632384:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1790779065.185728:0:17065:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779065.185986:0:17065:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779065.292874:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779065.543943:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779065.545261:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664448 00000100:00100000:2.0:1790779065.545273:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664448 00000100:00100000:2.0:1790779065.545328:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:2.0:1790779065.545336:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2342:x1877767510664448:12345-192.168.202.2@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790779065.545493:0:15007:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 36b1f440-03ca-4fd1-afff-83f1743e8b03@192.168.202.2@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1790779065.545521:0:15007:0:(genops.c:1384:class_connect()) connect: client 36b1f440-03ca-4fd1-afff-83f1743e8b03, cookie 0xdc87632656075c77 00000100:00080000:2.0:1790779065.545651:0:15007:0:(import.c:65:import_set_state_nolock()) ffff9ef20d3d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779065.545725:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+5:2342:x1877767510664448:12345-192.168.202.2@tcp:250:mount.lustre.0 Request processed in 388us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779065.545733:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:3.0:1790779065.551578:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779065.551753:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664576 00000100:00100000:0.0:1790779065.551764:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664576 00000100:00100000:0.0:1790779065.551837:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:0.0:1790779065.551848:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+5:13637:x1877767510664576:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790779065.551872:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779065.551895:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef23cb13a00/0xdc87632656075c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcfa0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779065.551931:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef23cb13a00/0xdc87632656075c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfa0 expref: 6 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779065.551942:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef23cb13a00/0xdc87632656075c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfa0 expref: 6 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779065.551950:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef23cb13a00, rc 0) 00000100:00100000:0.0:1790779065.552015:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+6:13637:x1877767510664576:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 169us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779065.552037:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:0.0:1790779065.558563:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.558628:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664704 00000100:00100000:3.0:1790779065.558639:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664704 00000100:00100000:3.0:1790779065.558701:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1790779065.558727:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+6:13637:x1877767510664704:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790779065.558871:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+6:13637:x1877767510664704:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 147us (318us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779065.558880:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:1.0:1790779065.575562:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779065.575770:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664832 00000100:00100000:2.0:1790779065.575782:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664832 00000100:00100000:2.0:1790779065.575839:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1790779065.575848:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+6:13637:x1877767510664832:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790779065.575866:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779065.575885:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de4800/0xdc87632656075c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcfa7 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779065.575912:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4800/0xdc87632656075c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfa7 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779065.575923:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de4800/0xdc87632656075c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfa7 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779065.575931:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4800, rc 0) 00000100:00100000:2.0:1790779065.576186:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+7:13637:x1877767510664832:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 338us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779065.576194:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1790779065.588766:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.588860:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510664960 00000100:00100000:3.0:1790779065.588871:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510664960 00000100:00100000:3.0:1790779065.588929:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1790779065.588939:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+7:13637:x1877767510664960:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790779065.589137:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13637:x1877767510664960:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 199us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.589146:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:2.0:1790779065.591561:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779065.591656:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665088 00000100:00100000:1.0:1790779065.591667:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665088 00000100:00100000:1.0:1790779065.591725:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1790779065.591735:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13637:x1877767510665088:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790779065.591908:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13637:x1877767510665088:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 174us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779065.591917:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1790779065.600670:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779065.603837:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665216 00000100:00100000:0.0:1790779065.603853:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665216 00000100:00100000:0.0:1790779065.603920:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:0.0:1790779065.603930:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13656:x1877767510665216:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790779065.604107:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13656:x1877767510665216:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 177us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779065.604116:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:2.0:1790779065.631574:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.631925:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665344 00000100:00100000:3.0:1790779065.631936:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665344 00000100:00100000:3.0:1790779065.631995:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1790779065.632005:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef202eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13656:x1877767510665344:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779065.632164:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef202eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13656:x1877767510665344:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 161us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.632173:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:2.0:1790779065.640197:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779065.640300:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665472 00000100:00100000:1.0:1790779065.640309:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665472 00000100:00100000:1.0:1790779065.640369:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1790779065.640379:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+8:13637:x1877767510665472:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790779065.640398:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779065.640433:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236387400/0xdc87632656075c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcfd1 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779065.640507:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236387400/0xdc87632656075c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd1 expref: 9 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779065.640518:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236387400/0xdc87632656075c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd1 expref: 9 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779065.640527:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387400, rc 0) 00000100:00100000:1.0:1790779065.640587:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+9:13637:x1877767510665472:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 209us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779065.640594:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1790779065.652383:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779065.654700:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665600 00000100:00100000:0.0:1790779065.654717:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665600 00000100:00100000:0.0:1790779065.654792:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1790779065.654804:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+9:13637:x1877767510665600:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790779065.654832:0:15008:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790779065.654856:0:15008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790779065.654861:0:15008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790779065.654864:0:15008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790779065.654867:0:15008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1790779065.661871:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+9:13637:x1877767510665600:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 7057us (9487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.661887:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:2.0:1790779065.666796:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.666876:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665728 00000100:00100000:3.0:1790779065.666887:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665728 00000100:00100000:3.0:1790779065.666943:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1790779065.666952:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+9:13637:x1877767510665728:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779065.666982:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779065.667002:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dcfd8 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779065.667031:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 10 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779065.667043:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 10 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779065.667053:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0600, rc 0) 00000100:00100000:3.0:1790779065.667115:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13637:x1877767510665728:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 164us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.667123:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:1.0:1790779065.673045:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.673135:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665856 00000100:00100000:3.0:1790779065.673145:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665856 00000100:00100000:3.0:1790779065.673203:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1790779065.673214:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13637:x1877767510665856:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790779065.673882:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13637:x1877767510665856:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 665us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.673891:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:0.0:1790779065.675632:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779065.675765:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510665984 00000100:00100000:2.0:1790779065.675774:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510665984 00000100:00100000:2.0:1790779065.675925:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:2.0:1790779065.675936:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13637:x1877767510665984:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790779065.676138:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13637:x1877767510665984:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 204us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779065.676146:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:2.0:1790779065.678832:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.678923:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666112 00000100:00100000:3.0:1790779065.678988:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666112 00000100:00100000:3.0:1790779065.679296:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1790779065.679314:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13660:x1877767510666112:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779065.680518:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13660:x1877767510666112:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 1206us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779065.680529:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1790779065.694801:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779065.694997:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666240 00000100:00100000:2.0:1790779065.695009:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666240 00000100:00100000:2.0:1790779065.695080:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:2.0:1790779065.695091:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13660:x1877767510666240:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779065.695231:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13660:x1877767510666240:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779065.695240:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:0.0:1790779065.706853:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.707147:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666368 00000100:00100000:3.0:1790779065.707171:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666368 00000100:00100000:3.0:1790779065.707218:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1790779065.707225:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2342:x1877767510666368:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790779065.707252:0:15015:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf@192.168.202.2@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1790779065.707298:0:15015:0:(genops.c:1384:class_connect()) connect: client 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf, cookie 0xdc87632656075c9a 00000004:00100000:3.0:1790779065.707325:0:15015:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1790779065.707331:0:15015:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1790779065.732420:0:15015:0:(import.c:65:import_set_state_nolock()) ffff9ef2332de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779065.732574:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2342:x1877767510666368:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 25346us (25728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.732586:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1790779065.735903:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779065.735944:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.736038:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666624 00000100:00100000:3.0:1790779065.736059:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666624 00000100:00100000:1.0:1790779065.736111:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666496 00000100:00100000:1.0:1790779065.736116:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666496 00000100:00100000:3.0:1790779065.736137:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00080000:2.0:1790779065.736190:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779065.736289:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:13637:x1877767510666624:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790779065.736330:0:15016:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1790779065.736475:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:13637:x1877767510666624:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 150us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.736482:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1790779065.736501:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1790779065.736508:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2369b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:0:x1877767510666496:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790779065.736519:0:15016:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1790779065.736548:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2369b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:0:x1877767510666496:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 40us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779065.736554:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1790779065.739487:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779065.739691:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666752 00000100:00100000:0.0:1790779065.739702:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666752 00000100:00100000:0.0:1790779065.739806:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1790779065.739817:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13637:x1877767510666752:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790779065.739941:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13637:x1877767510666752:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 125us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779065.739949:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1790779065.744705:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779065.744995:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779065.745646:0:16906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510666880 00000100:00100000:3.0:1790779065.745657:0:16906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510666880 00000100:00100000:1.0:1790779065.745753:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779065.745814:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667008 00000100:00100000:2.0:1790779065.745818:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667008 00000100:00100000:0.0:1790779065.745883:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667136 00000100:00100000:0.0:1790779065.745887:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667136 00000100:00100000:2.0:1790779065.745913:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790779065.745919:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1790779065.745921:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1877767510667008:12345-192.168.202.2@tcp:8:mount.lustre.0 00000100:00100000:0.0:1790779065.745926:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13637:x1877767510667136:12345-192.168.202.2@tcp:33:mount.lustre.0 00010000:00080000:2.0:1790779065.745964:0:15796:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf@192.168.202.2@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1790779065.745995:0:15796:0:(genops.c:1384:class_connect()) connect: client 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf, cookie 0xdc87632656075ca1 00002000:00100000:2.0:1790779065.746006:0:15796:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf/ffff9ef2369d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790779065.746026:0:15796:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790779065.746214:0:15796:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790779065.746243:0:15796:0:(import.c:65:import_set_state_nolock()) ffff9ef206dac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779065.746311:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2342:x1877767510667008:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 387us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779065.746319:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790779065.746800:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1790779065.746807:0:16906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2342:x1877767510666880:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790779065.746827:0:16906:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf@192.168.202.2@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1790779065.746846:0:16906:0:(genops.c:1384:class_connect()) connect: client 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf, cookie 0xdc87632656075ca8 00002000:00100000:0.0:1790779065.746854:0:16906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf/ffff9ef23333f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790779065.746860:0:16906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790779065.746988:0:16906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790779065.747007:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9ef23333c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779065.747469:0:16906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2342:x1877767510666880:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 658us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779065.747477:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000004:00080000:0.0:1790779065.747500:0:15017:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1496us 00000004:00200000:0.0:1790779065.762715:0:15017:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790779065.762947:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13637:x1877767510667136:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 17015us (17947us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779065.762959:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000040:00080000:3.0:1790779065.868282:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790779066.020624:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779066.020956:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667264 00000100:00100000:0.0:1790779066.020979:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667264 00000100:00100000:0.0:1790779066.021040:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790779066.021051:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13681:x1877767510667264:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:0.0:1790779066.021072:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779066.021098:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb13800/0xdc87632656075caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd002 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779066.021325:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb12e00/0xdc87632656075cb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779066.021340:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb12e00/0xdc87632656075cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779066.021356:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb12e00/0xdc87632656075cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779066.021580:0:15015:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790779066.021584:0:15015:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790779066.021621:0:15015:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb12e00/0xdc87632656075cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779066.021646:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb13800/0xdc87632656075caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd002 expref: 8 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779066.021662:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb12e00/0xdc87632656075cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd002 expref: 7 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779066.021671:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:0.0:1790779066.021674:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790779066.021677:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef23cb12e00, rc 0) 00000100:00100000:0.0:1790779066.021848:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:13681:x1877767510667264:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 798us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779066.021857:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:2.0:1790779066.318749:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779067.339701:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779067.403643:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779067.403666:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531632512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779067.403700:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531632640:0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.403734:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779067.403734:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779067.403798:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531632768:0@lo:400:kworker.0 00000100:00100000:1.0:1790779067.403814:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531633024:0@lo:400:kworker.0 00000100:00100000:0.0:1790779067.405594:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531632896:0@lo:400:kworker.0 00000100:00100000:0.0:1790779067.405651:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779067.405810:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632512 00000100:00100000:0.0:1790779067.405819:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632512 00000100:00100000:0.0:1790779067.405876:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779067.405887:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531632512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779067.405919:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790779067.405966:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531632512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779067.405974:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790779067.405996:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779067.406041:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531632512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779067.406083:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632640 00000100:00100000:0.0:1790779067.406087:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632640 00000100:00100000:0.0:1790779067.406111:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790779067.406118:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3439:x1877767531632640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779067.406167:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3439:x1877767531632640:12345-0@lo:400:kworker.0 Request processed in 49us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779067.406175:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790779067.408592:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531632640:0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.408610:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531633152:0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.408663:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779067.408726:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633152 00000100:00100000:3.0:1790779067.408732:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633152 00000100:00100000:3.0:1790779067.408777:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779067.408790:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.408837:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531633152:12345-0@lo:400:kworker.0 Request processed in 54us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779067.408844:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790779067.408861:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779067.408880:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531633152:0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.408911:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632896 00000100:00100000:3.0:1790779067.408915:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632896 00000100:00100000:3.0:1790779067.408936:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779067.408942:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.408975:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531632896:12345-0@lo:400:kworker.0 Request processed in 34us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779067.408981:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779067.409005:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531632896:0@lo:400:kworker.0 00000100:00100000:2.0:1790779067.414261:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779067.414330:0:16906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531632768 00000100:00100000:2.0:1790779067.414340:0:16906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531632768 00000100:00100000:2.0:1790779067.414403:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779067.414413:0:16906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531632768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779067.414494:0:16906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3440:x1877767531632768:12345-0@lo:400:kworker.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779067.414501:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790779067.414526:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779067.414559:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3440:1877767531632768:0@lo:400:kworker.0 00000100:00100000:2.0:1790779067.414571:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531633280:0@lo:400:kworker.0 00000100:00100000:2.0:1790779067.414605:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779067.414643:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633280 00000100:00100000:2.0:1790779067.414646:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633280 00000100:00100000:2.0:1790779067.414677:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790779067.414684:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531633280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779067.414715:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531633280:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779067.414721:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790779067.414735:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779067.414753:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531633280:0@lo:400:kworker.0 00000100:00100000:0.0:1790779067.426114:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779067.426273:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633024 00000100:00100000:3.0:1790779067.426290:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633024 00000100:00100000:3.0:1790779067.426349:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779067.426359:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531633024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779067.426437:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531633024:12345-0@lo:400:kworker.0 Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779067.426475:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779067.429535:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531633024:0@lo:400:kworker.0 00000001:00100000:1.0:1790779067.922409:0:16609:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf 00000100:00100000:1.0:1790779068.160071:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.160203:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667392 00000100:00100000:3.0:1790779068.160220:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667392 00000100:00080000:0.0:1790779068.160301:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779068.160311:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1790779068.160324:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:13733:x1877767510667392:12345-192.168.202.2@tcp:41:lfs.0 00000004:00000024:3.0:1790779068.160362:0:15014:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1790779068.160506:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:13733:x1877767510667392:12345-192.168.202.2@tcp:41:lfs.0 Request processed in 185us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.160514:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1790779068.165044:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779068.165168:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667520 00000100:00100000:0.0:1790779068.165182:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667520 00000100:00100000:0.0:1790779068.165285:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1790779068.165298:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13733:x1877767510667520:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:0.0:1790779068.165342:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1790779068.165508:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:13733:x1877767510667520:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 212us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.165518:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00080000:2.0:1790779068.165598:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779068.174620:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779068.174729:0:15801:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667648 00000100:00100000:1.0:1790779068.174745:0:15801:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667648 00000100:00100000:1.0:1790779068.174935:0:15801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1790779068.174947:0:15801:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:13733:x1877767510667648:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:1.0:1790779068.174975:0:15801:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790779068.175095:0:15801:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:13733:x1877767510667648:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 149us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779068.175104:0:15801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00080000:2.0:1790779068.175196:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779068.356345:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.356656:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667776 00000100:00100000:3.0:1790779068.356671:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667776 00000100:00100000:3.0:1790779068.356807:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1790779068.356820:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+10:13766:x1877767510667776:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790779068.356843:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779068.356864:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef2358a0400/0xdc87632656075cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd009 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.356902:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef2358a0400/0xdc87632656075cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd009 expref: 11 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.356914:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef2358a0400/0xdc87632656075cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd009 expref: 11 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.356945:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0400, rc 0) 00000100:00100000:3.0:1790779068.357041:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13766:x1877767510667776:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 223us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.357049:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1790779068.360177:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779068.360479:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510667904 00000100:00100000:0.0:1790779068.360494:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510667904 00000100:00100000:0.0:1790779068.360569:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1790779068.360581:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13766:x1877767510667904:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790779068.360795:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13766:x1877767510667904:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 215us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.360814:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1790779068.368143:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.368584:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668032 00000100:00100000:3.0:1790779068.368599:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668032 00000100:00100000:3.0:1790779068.368671:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:3.0:1790779068.368682:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13766:x1877767510668032:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790779068.370551:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13766:x1877767510668032:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 1859us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.370567:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00010000:00010000:2.0:1790779068.372931:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779068.390607:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779068.395405:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668160 00000100:00100000:2.0:1790779068.395438:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668160 00000100:00100000:2.0:1790779068.395548:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1790779068.395561:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13773:x1877767510668160:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779068.395967:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13773:x1877767510668160:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 408us (5374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.395977:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:0.0:1790779068.439507:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779068.439647:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668288 00000100:00100000:2.0:1790779068.439661:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668288 00000100:00100000:2.0:1790779068.439780:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:2.0:1790779068.439793:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13773:x1877767510668288:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779068.440012:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13773:x1877767510668288:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 221us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.440023:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1790779068.451643:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779068.452689:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668416 00000100:00100000:2.0:1790779068.452717:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668416 00000100:00100000:2.0:1790779068.452797:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:2.0:1790779068.452819:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13766:x1877767510668416:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790779068.452841:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779068.452870:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de4a00/0xdc87632656075cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd033 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779068.452910:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4a00/0xdc87632656075cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd033 expref: 12 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779068.452928:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de4a00/0xdc87632656075cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd033 expref: 12 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779068.452939:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4a00, rc 0) 00000100:00100000:2.0:1790779068.453378:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13766:x1877767510668416:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 569us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.453387:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:1.0:1790779068.458419:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779068.458582:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668544 00000100:00100000:2.0:1790779068.458596:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668544 00000100:00100000:2.0:1790779068.458670:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:2.0:1790779068.458681:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13766:x1877767510668544:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790779068.458714:0:15008:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790779068.458747:0:15008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790779068.458752:0:15008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790779068.458755:0:15008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790779068.458757:0:15008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790779068.461349:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13766:x1877767510668544:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 2654us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.461378:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:0.0:1790779068.464014:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.464607:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668672 00000100:00100000:3.0:1790779068.464620:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668672 00000100:00100000:0.0:1790779068.464881:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:0.0:1790779068.464893:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2335f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13766:x1877767510668672:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790779068.464916:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779068.464939:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd03a expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779068.464994:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 13 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779068.465009:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 13 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779068.465020:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef23cb12200, rc 0) 00000100:00100000:0.0:1790779068.465545:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2335f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13766:x1877767510668672:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 653us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.465554:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1790779068.469523:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779068.469790:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668800 00000100:00100000:2.0:1790779068.469869:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668800 00000100:00100000:2.0:1790779068.469988:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1790779068.470000:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13766:x1877767510668800:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790779068.470543:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13766:x1877767510668800:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 542us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.470554:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:3.0:1790779068.473002:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779068.473125:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510668928 00000100:00100000:0.0:1790779068.473137:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510668928 00000100:00100000:0.0:1790779068.473217:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:0.0:1790779068.473229:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13766:x1877767510668928:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790779068.473430:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13766:x1877767510668928:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 202us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.473438:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:0.0:1790779068.479006:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779068.479601:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669056 00000100:00100000:2.0:1790779068.479615:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669056 00000100:00100000:2.0:1790779068.479687:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:2.0:1790779068.479700:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13779:x1877767510669056:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779068.479907:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13779:x1877767510669056:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 210us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.479917:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:1.0:1790779068.488326:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.488542:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669184 00000100:00100000:3.0:1790779068.488557:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669184 00000100:00100000:3.0:1790779068.488635:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:3.0:1790779068.488648:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13779:x1877767510669184:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790779068.488879:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13779:x1877767510669184:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 232us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.488888:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:3.0:1790779068.506551:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.506603:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.506629:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.506808:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.506850:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669696 00000100:00100000:3.0:1790779068.506862:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669696 00000100:00100000:3.0:1790779068.506923:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669824 00000100:00100000:3.0:1790779068.506926:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669824 00000100:00100000:3.0:1790779068.506954:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1790779068.506965:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2343:x1877767510669696:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779068.507079:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2343:x1877767510669696:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 115us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.507089:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1790779068.507111:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1790779068.507118:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2343:x1877767510669824:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779068.507146:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2343:x1877767510669824:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.507152:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1790779068.512473:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669312 00000100:00100000:1.0:1790779068.512499:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669312 00000100:00100000:2.0:1790779068.514994:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669568 00000100:00100000:2.0:1790779068.515018:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669568 00000100:00100000:0.0:1790779068.519421:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1790779068.519435:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2342:x1877767510669312:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790779068.519496:0:15014:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 15accbd5-659f-4ca9-8da3-b9762ddb0659@192.168.202.2@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1790779068.519552:0:15014:0:(genops.c:1384:class_connect()) connect: client 15accbd5-659f-4ca9-8da3-b9762ddb0659, cookie 0xdc87632656075cd2 00000004:00100000:0.0:1790779068.519587:0:15014:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790779068.519720:0:15014:0:(import.c:65:import_set_state_nolock()) ffff9ef236490800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779068.520332:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2342:x1877767510669312:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 895us (13794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.520361:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1790779068.524712:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1790779068.524732:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2343:x1877767510669568:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790779068.525264:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2343:x1877767510669568:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 533us (18629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779068.525276:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1790779068.539398:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779068.539540:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.539730:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669440 00000100:00100000:3.0:1790779068.539745:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669440 00000100:00100000:3.0:1790779068.539942:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510669952 00000100:00100000:3.0:1790779068.539946:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510669952 00000100:00100000:3.0:1790779068.539970:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1790779068.539981:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+7:0:x1877767510669440:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790779068.540265:0:15014:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1790779068.540368:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+7:0:x1877767510669440:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 388us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.540377:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1790779068.540404:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790779068.540478:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13766:x1877767510669952:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790779068.540495:0:15014:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1790779068.540522:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13766:x1877767510669952:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 79us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.540528:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00080000:2.0:1790779068.542942:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779068.545364:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779068.545502:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670080 00000100:00100000:1.0:1790779068.545516:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670080 00000100:00100000:1.0:1790779068.545642:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1790779068.545654:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13766:x1877767510670080:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790779068.545787:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13766:x1877767510670080:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 135us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779068.545797:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1790779068.548936:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779068.548980:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779068.549133:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779068.549572:0:15018:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670464 00000100:00100000:1.0:1790779068.549587:0:15018:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670464 00000100:00100000:1.0:1790779068.549652:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1790779068.549664:0:15018:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13766:x1877767510670464:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790779068.549784:0:15018:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790779068.549894:0:15018:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13766:x1877767510670464:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 232us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779068.549904:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1790779068.550595:0:16906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670208 00000100:00100000:2.0:1790779068.550603:0:16906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670208 00000100:00100000:2.0:1790779068.550633:0:16906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670336 00000100:00100000:2.0:1790779068.550636:0:16906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670336 00000100:00100000:2.0:1790779068.550660:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790779068.550667:0:16906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2342:x1877767510670208:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790779068.550700:0:16906:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 15accbd5-659f-4ca9-8da3-b9762ddb0659@192.168.202.2@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1790779068.550744:0:16906:0:(genops.c:1384:class_connect()) connect: client 15accbd5-659f-4ca9-8da3-b9762ddb0659, cookie 0xdc87632656075cd9 00002000:00100000:2.0:1790779068.550770:0:16906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15accbd5-659f-4ca9-8da3-b9762ddb0659/ffff9ef240ef1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790779068.550785:0:16906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790779068.550889:0:16906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790779068.550925:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9ef240ef2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779068.550979:0:16906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2342:x1877767510670208:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 309us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.550987:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790779068.551004:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1790779068.551009:0:16906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2342:x1877767510670336:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790779068.551156:0:16906:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 15accbd5-659f-4ca9-8da3-b9762ddb0659@192.168.202.2@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1790779068.551185:0:16906:0:(genops.c:1384:class_connect()) connect: client 15accbd5-659f-4ca9-8da3-b9762ddb0659, cookie 0xdc87632656075ce0 00002000:00100000:2.0:1790779068.551258:0:16906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15accbd5-659f-4ca9-8da3-b9762ddb0659/ffff9ef240ef0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790779068.551266:0:16906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790779068.551322:0:16906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790779068.551339:0:16906:0:(import.c:65:import_set_state_nolock()) ffff9ef240ef2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779068.551636:0:16906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2342:x1877767510670336:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 624us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779068.551645:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1790779068.789701:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779068.789910:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670592 00000100:00100000:3.0:1790779068.789925:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670592 00000100:00100000:3.0:1790779068.790325:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790779068.790341:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:13800:x1877767510670592:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:3.0:1790779068.790374:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779068.790415:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd064 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.790547:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.790564:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.790582:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779068.790645:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779068.790650:0:15014:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790779068.790677:0:15014:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.790720:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 8 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.790762:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 7 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779068.790772:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:3.0:1790779068.790776:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779068.790781:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1000, rc 0) 00000100:00100000:3.0:1790779068.790865:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+7:13800:x1877767510670592:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 528us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779068.790873:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00010000:00010000:2.0:1790779069.388500:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779069.453511:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779069.454139:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531633408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779069.454237:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779069.454397:0:15801:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633408 00000100:00100000:1.0:1790779069.454417:0:15801:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633408 00000100:00080000:3.0:1790779069.454763:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779069.454874:0:15801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790779069.454889:0:15801:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531633408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779069.454925:0:15801:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1790779069.455007:0:15801:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531633408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779069.455016:0:15801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779069.455107:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531633408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790779070.412676:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790779070.990804:0:15793:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15accbd5-659f-4ca9-8da3-b9762ddb0659 00000001:00100000:2.0:1790779070.990827:0:15793:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf 00000001:00100000:0.0:1790779070.992581:0:14994:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15accbd5-659f-4ca9-8da3-b9762ddb0659 00000001:00100000:0.0:1790779070.992599:0:14994:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf 00010000:00010000:2.0:1790779071.444701:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790779071.981129:0:17163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790779072.459694:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779072.526081:0:3441:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779072.526109:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531633536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779072.526194:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779072.526394:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633536 00000100:00100000:0.0:1790779072.526403:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633536 00000100:00100000:0.0:1790779072.526494:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779072.526504:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531633536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779072.526539:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1790779072.526608:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531633536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779072.526616:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790779072.526688:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779072.526901:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531633536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779072.530214:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531634048:0@lo:400:kworker.0 00000100:00100000:0.0:1790779072.530287:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779072.530343:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779072.530350:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531633920:0@lo:400:kworker.0 00000100:00100000:0.0:1790779072.530385:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779072.530416:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531634048 00000100:00100000:0.0:1790779072.530423:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531634048 00000100:00100000:0.0:1790779072.530502:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633920 00000100:00100000:0.0:1790779072.530507:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633920 00000100:00100000:0.0:1790779072.530524:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779072.530532:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531634048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779072.530585:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1877767531634048:12345-0@lo:400:kworker.0 Request processed in 54us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779072.530591:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779072.530605:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779072.530608:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531633920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779072.530625:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531633920:12345-0@lo:400:kworker.0 Request processed in 16us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779072.530628:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790779072.530781:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779072.530905:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531633664:0@lo:400:kworker.0 00000100:00100000:3.0:1790779072.530933:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779072.530970:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531634176:0@lo:400:kworker.0 00000100:00100000:3.0:1790779072.530994:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779072.531015:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779072.531020:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531633792:0@lo:400:kworker.0 00000100:00100000:3.0:1790779072.531043:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779072.531064:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531634176 00000100:00100000:3.0:1790779072.531067:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531634176 00000100:00100000:3.0:1790779072.531086:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779072.531090:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531634176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779072.531124:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3439:x1877767531634176:12345-0@lo:400:kworker.0 Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779072.531128:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779072.531143:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633792 00000100:00100000:3.0:1790779072.531145:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633792 00000100:00100000:3.0:1790779072.531162:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779072.531166:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531633792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779072.531184:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531633792:12345-0@lo:400:kworker.0 Request processed in 19us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779072.531189:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779072.531206:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531633792:0@lo:400:kworker.0 00000100:00100000:3.0:1790779072.531213:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3439:1877767531634176:0@lo:400:kworker.0 00000100:00100000:2.0:1790779072.531281:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531633664 00000100:00100000:2.0:1790779072.531285:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531633664 00000100:00100000:2.0:1790779072.531322:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790779072.531330:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3439:x1877767531633664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779072.531382:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3439:x1877767531633664:12345-0@lo:400:kworker.0 Request processed in 53us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779072.531389:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1790779072.531421:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779072.531425:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779072.531439:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531633664:0@lo:400:kworker.0 00000100:00100000:0.0:1790779072.531548:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531633920:0@lo:400:kworker.0 00000100:00100000:0.0:1790779072.531575:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3442:1877767531634048:0@lo:400:kworker.0 00010000:00010000:2.0:1790779073.488477:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779073.871153:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779073.871207:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670720 00000100:00100000:0.0:1790779073.871219:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670720 00000100:00100000:0.0:1790779073.871279:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:0.0:1790779073.871290:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2343:x1877767510670720:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790779073.871408:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2343:x1877767510670720:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 117us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.871428:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:0.0:1790779073.872081:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779073.872125:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779073.872150:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779073.872190:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779073.872215:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671104 00000100:00100000:0.0:1790779073.872223:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671104 00000100:00100000:0.0:1790779073.872274:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671360 00000100:00100000:0.0:1790779073.872277:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671360 00000100:00100000:0.0:1790779073.872297:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670976 00000100:00100000:0.0:1790779073.872299:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670976 00000100:00100000:0.0:1790779073.872318:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1790779073.872327:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510671104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790779073.872407:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510671104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.872415:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1790779073.872430:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790779073.872436:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2344:x1877767510671360:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790779073.872491:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2344:x1877767510671360:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 55us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.872498:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1790779073.872508:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790779073.872516:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2343:x1877767510670976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790779073.872539:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2343:x1877767510670976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779073.872561:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:0.0:1790779073.872580:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790779073.872584:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779073.874851:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510670848 00000100:00100000:3.0:1790779073.874880:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510670848 00000100:00100000:3.0:1790779073.875109:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1790779073.875127:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23639b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2344:x1877767510670848:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779073.875244:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23639b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2344:x1877767510670848:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 124us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779073.875254:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00080000:0.0:1790779073.875827:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779073.877923:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779073.878052:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779073.878185:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671232 00000100:00100000:1.0:1790779073.878201:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671232 00000100:00100000:1.0:1790779073.878298:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1790779073.878315:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2343:x1877767510671232:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790779073.878484:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2343:x1877767510671232:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 172us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779073.878493:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1790779073.879161:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671488 00000100:00100000:3.0:1790779073.879170:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671488 00000100:00100000:3.0:1790779073.879228:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1790779073.879238:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2343:x1877767510671488:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779073.879284:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2343:x1877767510671488:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 48us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779073.879312:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00080000:0.0:1790779073.879910:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790779073.879920:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1790779074.066052:0:16609:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15accbd5-659f-4ca9-8da3-b9762ddb0659 00010000:00010000:2.0:1790779074.509358:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779074.584125:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779074.584167:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531634304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790779074.584283:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779074.584411:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531634304 00000100:00100000:1.0:1790779074.584424:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531634304 00000100:00100000:1.0:1790779074.584542:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779074.584555:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531634304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779074.585950:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1790779074.586072:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531634304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1517us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779074.586084:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790779074.586131:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779074.586308:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531634304:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1790779075.091398:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790779075.532179:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790779076.486854:0:17310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9dcec4c0 20000000:00000080:0.0:1790779076.486874:0:17310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef23b4b5000 uarg=0000000000000000 20000000:01000000:0.0:1790779076.486918:0:17310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790779076.486923:0:17310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790779076.486928:0:17310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790779076.487863:0:17311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1790779076.488051:0:17310:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790779076.497679:0:17310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790779076.497711:0:17310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498036:0:17310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc876326560759e5 expref: 18 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498044:0:17310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075a32 expref: 18 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498051:0:17310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075b66 expref: 18 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498080:0:17310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 12 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498086:0:17310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 12 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498093:0:17310:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498137:0:17310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 12 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498152:0:17310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 12 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.498167:0:17310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236812d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634432:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790779076.498278:0:17310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 12 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498287:0:17310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 12 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.498296:0:17310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236810380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634560:192.168.202.2@tcp:104: 00010000:00010000:0.0:1790779076.498325:0:17310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656075b66 expref: 18 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.498348:0:17310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656075b66 expref: 18 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.498371:0:17310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236813b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634688:0@lo:104: 00000100:00100000:0.0:1790779076.498412:0:17310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790779076.498774:0:17310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc87632656075a32 expref: 18 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.498783:0:17310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc87632656075a32 expref: 18 pid: 15008 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779076.498792:0:17310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634816:0@lo:104: 00000100:00100000:1.0:1790779076.498818:0:17310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790779076.498847:0:17310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdc876326560759e5 expref: 18 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.498855:0:17310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdc876326560759e5 expref: 18 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779076.498863:0:17310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634944:0@lo:104: 00000100:00100000:1.0:1790779076.498886:0:17310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779076.498896:0:17310:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef214f15480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779076.499150:0:14998:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790779076.499163:0:14998:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531634688 00000100:00100000:3.0:1790779076.499169:0:14998:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531634688 00000100:00100000:3.0:1790779076.499206:0:14998:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531634816 00000100:00100000:3.0:1790779076.499208:0:14998:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531634816 00000100:00100000:3.0:1790779076.499217:0:14998:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531634944 00000100:00100000:3.0:1790779076.499219:0:14998:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531634944 00000100:00100000:3.0:1790779076.499231:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779076.499239:0:14998:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+5:17310:x1877767531634688:12345-0@lo:104: 00010000:00010000:3.0:1790779076.499252:0:14998:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.499303:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790779076.499308:0:14998:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+5:17310:x1877767531634688:12345-0@lo:104: Request processed in 71us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779076.499316:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779076.499343:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779076.499349:0:14998:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+4:17310:x1877767531634816:12345-0@lo:104: 00010000:00010000:3.0:1790779076.499355:0:14998:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.499383:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790779076.499387:0:14998:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+4:17310:x1877767531634816:12345-0@lo:104: Request processed in 40us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779076.499392:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779076.499410:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779076.499415:0:14998:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef20d329850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:17310:x1877767531634944:12345-0@lo:104: 00010000:00010000:3.0:1790779076.499421:0:14998:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779076.499467:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790779076.499473:0:14998:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef20d329850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+3:17310:x1877767531634944:12345-0@lo:104: Request processed in 58us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779076.499479:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779076.500173:0:17310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236813b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634688:0@lo:104: 00000100:00100000:1.0:1790779076.500181:0:17310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634816:0@lo:104: 00000100:00100000:1.0:1790779076.500185:0:17310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634944:0@lo:104: 00010000:00010000:1.0:1790779076.500204:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790779076.500210:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500225:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de4200 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790779076.500228:0:15002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500234:0:15002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779076.500239:0:15002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779076.500242:0:15002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790779076.500636:0:15002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500644:0:15002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779076.500666:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500672:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef235de4200/0xdc87632656075b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075b6d expref: -99 pid: 16608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500684:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779076.500687:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500693:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2014ab000 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:1.0:1790779076.500696:0:15002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500713:0:15002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779076.500720:0:15002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.500782:0:3442:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779076.500797:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3442:1877767531635072:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1790779076.500814:0:15002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790779076.500842:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790779076.500872:0:15002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500878:0:15002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779076.500885:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.500891:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef2014ab000/0xdc87632656075a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc87632656075a39 expref: -99 pid: 15792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.500901:0:15003:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779076.500901:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779076.500902:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779076.500904:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779076.500907:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.500914:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef20165b600 already unused, calling callback (ffffffffc14f3c20) 10000000:00010000:2.0:1790779076.500917:0:15003:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.500924:0:15003:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779076.500931:0:15003:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779076.500935:0:15003:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790779076.500995:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3442:1877767531635200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779076.501017:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779076.501046:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635072 00000100:00100000:0.0:1790779076.501051:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635072 00010000:00010000:0.0:1790779076.501093:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075b66 expref: 19 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.501115:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635200 00000100:00100000:0.0:1790779076.501118:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635200 00010000:00010000:0.0:1790779076.501129:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075a32 expref: 20 pid: 15008 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.501147:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779076.501154:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+20:3442:x1877767531635072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779076.501165:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779076.501170:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075b66 expref: 20 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.501178:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656075b66 expref: 20 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.501191:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a1400/0xdc87632656075b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656075b66 expref: 20 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.501209:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779076.501239:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3442:x1877767531635072:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779076.501246:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779076.501265:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779076.501271:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:3442:x1877767531635200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779076.501278:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779076.501282:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc87632656075a32 expref: 18 pid: 15008 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.501290:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc87632656075a32 expref: 18 pid: 15008 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.501300:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef20165ae00/0xdc87632656075a39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc87632656075a32 expref: 18 pid: 15008 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.501310:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779076.501341:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:3442:x1877767531635200:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779076.501349:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790779076.501383:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3442:1877767531635200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779076.501390:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3442:1877767531635072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779076.502192:0:15003:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.502214:0:15003:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790779076.502255:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531635328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779076.502291:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779076.502365:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779076.502372:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635328 00010000:00010000:2.0:1790779076.502373:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9ef20165b600/0xdc876326560759e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdc876326560759ec expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779076.502377:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635328 00010000:00010000:2.0:1790779076.502389:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779076.502391:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779076.502393:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779076.502397:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560759e5 expref: 17 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779076.502420:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779076.502426:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240df5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:3439:x1877767531635328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779076.502435:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779076.502438:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdc876326560759e5 expref: 17 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.502493:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdc876326560759e5 expref: 17 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.502504:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2014abc00/0xdc876326560759ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdc876326560759e5 expref: 17 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779076.502512:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779076.504318:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240df5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3439:x1877767531635328:12345-0@lo:103:ldlm_bl.0 Request processed in 1885us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779076.504322:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3439:1877767531635328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779076.504341:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779076.507870:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779076.507955:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779076.507972:0:17310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236812d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634432:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790779076.507983:0:17310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236810380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17310:1877767531634560:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790779076.508018:0:17310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.508192:0:15001:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671616 00000100:00100000:0.0:1790779076.508269:0:15001:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671616 00010000:00010000:0.0:1790779076.508303:0:15001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 13 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779076.508383:0:15001:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671744 00000100:00100000:0.0:1790779076.508388:0:15001:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671744 00010000:00010000:0.0:1790779076.508401:0:15001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 14 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779076.508563:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1790779076.508574:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36b1f440-03ca-4fd1-afff-83f1743e8b03+14:2345:x1877767510671616:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779076.508588:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779076.508594:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 14 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508605:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 14 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508622:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef23cb12200/0xdc87632656075ccb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd03a expref: 14 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508635:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779076.508691:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2345:x1877767510671616:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 119us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.508699:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1790779076.508735:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1790779076.508855:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:2345:x1877767510671744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779076.508866:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779076.508871:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 12 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508880:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 12 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508890:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef2358a0600/0xdc87632656075c93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dcfd8 expref: 12 pid: 15009 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508901:0:15000:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508910:0:15000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508924:0:15000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508932:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508940:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508948:0:15000:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508954:0:15000:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb13800 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:2.0:1790779076.508965:0:15000:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.508974:0:15000:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.509418:0:17310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779076.509429:0:17310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.513971:0:15000:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.513991:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef23cb13800/0xdc87632656075cf5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779076.514013:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779076.514733:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:2345:x1877767510671744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 5985us (6770us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779076.515001:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:1.0:1790779076.557737:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779077.583099:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779077.651593:0:3439:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779077.651621:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531635456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779077.651709:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779077.651836:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635456 00000100:00100000:3.0:1790779077.651845:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635456 00000100:00100000:3.0:1790779077.651910:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779077.651921:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531635456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779077.651952:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1790779077.652001:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531635456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.652009:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790779077.652242:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779077.652285:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531635456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779077.652827:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531635584:0@lo:400:kworker.0 00000100:00100000:2.0:1790779077.652866:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779077.652932:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635584 00000100:00100000:3.0:1790779077.652938:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635584 00000100:00100000:3.0:1790779077.652971:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790779077.652980:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3441:x1877767531635584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779077.656593:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531635712:0@lo:400:kworker.0 00000100:00100000:0.0:1790779077.656711:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779077.662497:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:3441:x1877767531635584:12345-0@lo:400:kworker.0 Request processed in 9509us (9621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.662513:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790779077.662722:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635712 00000100:00100000:3.0:1790779077.662731:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635712 00000100:00100000:3.0:1790779077.662814:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779077.662823:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779077.662913:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531635712:12345-0@lo:400:kworker.0 Request processed in 91us (6201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779077.662920:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779077.662962:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531635712:0@lo:400:kworker.0 00000100:00100000:2.0:1790779077.663067:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3441:1877767531635584:0@lo:400:kworker.0 00000100:00080000:2.0:1790779077.663088:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779077.667285:0:3440:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779077.667306:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531635840:0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667381:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779077.667426:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635840 00000100:00100000:1.0:1790779077.667434:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635840 00000100:00100000:1.0:1790779077.667504:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790779077.667513:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531635840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667566:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3440:x1877767531635840:12345-0@lo:400:kworker.0 Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.667573:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790779077.667616:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3440:1877767531635840:0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667668:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531635968:0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667696:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779077.667721:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531635968 00000100:00100000:1.0:1790779077.667724:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531635968 00000100:00100000:1.0:1790779077.667751:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790779077.667757:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531635968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667788:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3440:x1877767531635968:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.667794:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790779077.667817:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3440:1877767531635968:0@lo:400:kworker.0 00000100:00080000:1.0:1790779077.667829:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779077.667861:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531636096:0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667886:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779077.667902:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636096 00000100:00100000:1.0:1790779077.667905:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636096 00000100:00100000:1.0:1790779077.667928:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779077.667934:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531636096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779077.667962:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3441:x1877767531636096:12345-0@lo:400:kworker.0 Request processed in 29us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779077.667968:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790779077.667981:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779077.667994:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3441:1877767531636096:0@lo:400:kworker.0 10000000:01000000:2.0:1790779078.094040:0:15011:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790779078.094047:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef208c12800 from 10 10000000:01000000:2.0:1790779078.094052:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790779078.094103:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.094115:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.094127:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779078.094154:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779078.094225:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779078.094276:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779078.094298:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636224 00000100:00100000:2.0:1790779078.094304:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636224 00000100:00100000:2.0:1790779078.094358:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790779078.094366:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+16:15011:x1877767531636224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779078.094381:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779078.094393:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de4400/0xdc87632656075d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075cfc expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.094413:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de4400/0xdc87632656075d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075cfc expref: 17 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.094422:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de4400/0xdc87632656075d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075cfc expref: 17 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.094431:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de4400, rc 0) 00000100:00100000:2.0:1790779078.094506:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:15011:x1877767531636224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779078.094513:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790779078.094762:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779078.094776:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d03 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.094785:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075d03 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779078.094835:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779078.094859:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779078.094918:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779078.096707:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636352 00000100:00100000:0.0:1790779078.096724:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636352 00000100:00100000:0.0:1790779078.096789:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779078.096798:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:15011:x1877767531636352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.096962:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:15011:x1877767531636352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.096970:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779078.097029:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.097093:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.097151:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779078.097197:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b4b0300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779078.097211:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636480 00000100:00100000:0.0:1790779078.097214:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636480 00000100:00100000:0.0:1790779078.097237:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790779078.097244:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:15011:x1877767531636480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.097344:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:15011:x1877767531636480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.097351:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790779078.097388:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779078.101358:0:17360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790779078.102063:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790779078.102101:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779078.102117:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d03 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.102132:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef235de5800/0xdc87632656075cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d03 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779078.102144:0:15011:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779078.102147:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef2201e1800 from 10 10000000:01000000:0.0:1790779078.102150:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779078.102200:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.102209:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.102229:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779078.102259:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.102374:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779078.102436:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b4b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1790779078.102689:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636608 00000100:00100000:1.0:1790779078.102700:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636608 00000100:00100000:1.0:1790779078.102789:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790779078.102805:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+17:15011:x1877767531636608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779078.102822:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779078.102835:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236386600/0xdc87632656075d11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075d0a expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.102859:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236386600/0xdc87632656075d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075d0a expref: 18 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.102870:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236386600/0xdc87632656075d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075d0a expref: 18 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.102880:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386600, rc 0) 00000100:00100000:1.0:1790779078.102942:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531636608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779078.102949:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790779078.103028:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779078.103046:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d11 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779078.103056:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075d11 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779078.103124:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779078.103168:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779078.110739:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779078.110836:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636736 00000100:00100000:0.0:1790779078.110847:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636736 00000100:00100000:0.0:1790779078.110899:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790779078.110910:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531636736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.111094:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531636736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (7924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.111104:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790779078.111300:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779078.111367:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779078.111429:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779078.111733:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779078.112675:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636864 00000100:00100000:0.0:1790779078.112689:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636864 00000100:00100000:0.0:1790779078.112749:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790779078.112760:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531636864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.112893:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531636864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.112901:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790779078.114132:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790779078.115998:0:17362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790779078.116089:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790779078.116116:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779078.116129:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d11 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.116142:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef23cb12400/0xdc87632656075d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d11 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779078.116155:0:15011:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779078.116171:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef236c63800 from 10 10000000:01000000:0.0:1790779078.116175:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779078.116227:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.116236:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.116250:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779078.116280:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236810700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.116388:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779078.116471:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b4b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1790779078.116681:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531636992 00000100:00100000:1.0:1790779078.116692:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531636992 00000100:00100000:1.0:1790779078.116744:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790779078.116753:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+18:15011:x1877767531636992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779078.116769:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779078.116784:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef236387600/0xdc87632656075d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc87632656075d18 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.116807:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef236387600/0xdc87632656075d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdc87632656075d18 expref: 19 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.116818:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef236387600/0xdc87632656075d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdc87632656075d18 expref: 19 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.116838:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387600, rc 0) 00000100:00100000:1.0:1790779078.116878:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531636992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779078.116885:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790779078.116928:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236810700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531636992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779078.116941:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d1f expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.116951:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdc87632656075d1f expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779078.116999:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779078.117022:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779078.117034:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779078.117043:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531637120 00000100:00100000:1.0:1790779078.117047:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531637120 00000100:00100000:1.0:1790779078.117062:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790779078.117068:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531637120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779078.117169:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531637120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779078.117176:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790779078.117203:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531637120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779078.117228:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531637248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779078.117268:0:15011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779078.117289:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef2055d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779078.117300:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531637248 00000100:00100000:1.0:1790779078.117304:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531637248 00000100:00100000:1.0:1790779078.117337:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790779078.117344:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23bba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531637248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779078.117422:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23bba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:15011:x1877767531637248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779078.117430:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790779078.117491:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5971fcd9-bd47-4c7f-984b-89395cac9bc1:15011:1877767531637248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779078.118259:0:17363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790779078.118332:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790779078.118352:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779078.118360:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d1f expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779078.118370:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9ef23cb13c00/0xdc87632656075d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdc87632656075d1f expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779078.223844:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779078.227278:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510671872 00000100:00100000:1.0:1790779078.227300:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510671872 00000100:00100000:0.0:1790779078.228896:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:0.0:1790779078.228910:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+11:13651:x1877767510671872:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779078.228930:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779078.228948:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef23cb13000/0xdc87632656075d26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd06b expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.228978:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef23cb13000/0xdc87632656075d26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd06b expref: 12 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.228989:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef23cb13000/0xdc87632656075d26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd06b expref: 12 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779078.228998:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef23cb13000, rc 0) 00000100:00100000:0.0:1790779078.229076:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13651:x1877767510671872:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 169us (5373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.229103:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:1.0:1790779078.235279:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.235374:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672000 00000100:00100000:3.0:1790779078.235383:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672000 00000100:00100000:3.0:1790779078.235437:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:3.0:1790779078.235470:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13651:x1877767510672000:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779078.235658:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13651:x1877767510672000:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 190us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.235680:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:3.0:1790779078.244389:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.244434:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672128 00000100:00100000:3.0:1790779078.244462:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672128 00000100:00100000:3.0:1790779078.244514:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:3.0:1790779078.244533:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13651:x1877767510672128:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779078.244681:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13651:x1877767510672128:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 159us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.244689:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:2.0:1790779078.264972:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779078.265013:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672256 00000100:00100000:2.0:1790779078.265024:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672256 00000100:00100000:2.0:1790779078.265073:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:2.0:1790779078.265084:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+12:13651:x1877767510672256:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779078.265113:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779078.265132:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef235de5c00/0xdc87632656075d2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd072 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.265161:0:15007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef235de5c00/0xdc87632656075d2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd072 expref: 13 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.265174:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef235de5c00/0xdc87632656075d2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd072 expref: 13 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779078.265184:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235de5c00, rc 0) 00000100:00100000:2.0:1790779078.265241:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13651:x1877767510672256:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 159us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779078.265258:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:3.0:1790779078.272214:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.272250:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672384 00000100:00100000:3.0:1790779078.272258:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672384 00000100:00100000:3.0:1790779078.272307:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1790779078.272329:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13651:x1877767510672384:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779078.272497:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13651:x1877767510672384:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 180us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.272506:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:2.0:1790779078.296788:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779078.296913:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672512 00000100:00100000:0.0:1790779078.296924:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672512 00000100:00100000:0.0:1790779078.296973:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:0.0:1790779078.296983:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13651:x1877767510672512:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779078.297392:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:13651:x1877767510672512:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 407us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.297401:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00010000:00010000:1.0:1790779078.607729:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779078.991075:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991119:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991146:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991166:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991187:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991205:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991227:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779078.991254:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672896 00000100:00100000:3.0:1790779078.991278:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672896 00000100:00100000:3.0:1790779078.991343:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673408 00000100:00100000:3.0:1790779078.991347:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673408 00000100:00100000:3.0:1790779078.991360:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673024 00000100:00100000:3.0:1790779078.991362:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673024 00000100:00100000:3.0:1790779078.991373:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673280 00000100:00100000:3.0:1790779078.991375:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673280 00000100:00100000:3.0:1790779078.991393:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790779078.991403:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510672896:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779078.991509:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510672896:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 106us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.991516:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790779078.991534:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1790779078.991541:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2344:x1877767510673408:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779078.991566:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2344:x1877767510673408:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.991572:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1790779078.991583:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790779078.991590:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510673024:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779078.991613:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510673024:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.991619:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1790779078.991630:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1790779078.991636:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2344:x1877767510673280:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779078.991658:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2344:x1877767510673280:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 22us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.991671:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1790779078.991691:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673152 00000100:00100000:3.0:1790779078.991695:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673152 00000100:00100000:3.0:1790779078.991729:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672768 00000100:00100000:3.0:1790779078.991732:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672768 00000100:00100000:3.0:1790779078.991748:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1790779078.991754:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2344:x1877767510673152:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779078.991783:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2344:x1877767510673152:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.991790:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1790779078.991801:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1790779078.991808:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2344:x1877767510672768:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779078.991832:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2344:x1877767510672768:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779078.991838:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00080000:3.0:1790779078.991867:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779078.991872:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779078.991874:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779078.992194:0:15007:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510672640 00000100:00100000:0.0:1790779078.992199:0:15007:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510672640 00000100:00100000:0.0:1790779078.992235:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:0.0:1790779078.992243:0:15007:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2344:x1877767510672640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1790779078.992279:0:15007:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2344:x1877767510672640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 38us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779078.992285:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00010000:00010000:2.0:1790779079.627709:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779079.691809:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531637376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779079.691901:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779079.692027:0:15800:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531637376 00000100:00100000:0.0:1790779079.692036:0:15800:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531637376 00000100:00100000:0.0:1790779079.692109:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790779079.692121:0:15800:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531637376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779079.692150:0:15800:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00080000:2.0:1790779079.692415:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779079.696124:0:15800:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531637376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3995us (4222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779079.696139:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779079.700018:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531637376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790779080.651880:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779080.916011:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779080.919180:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673536 00000100:00100000:1.0:1790779080.919197:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673536 00000100:00100000:1.0:1790779080.919320:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1790779080.919334:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:14311:x1877767510673536:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790779080.919355:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779080.919392:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd079 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790779080.919402:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790779080.919494:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919511:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919524:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919540:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919548:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919555:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919646:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387200/0xdc87632656075d49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919654:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387200/0xdc87632656075d49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919661:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387200/0xdc87632656075d49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779080.919690:0:15015:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779080.919694:0:15015:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790779080.919729:0:15015:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387200/0xdc87632656075d49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919746:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919753:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919761:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919766:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779080.919770:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919778:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919789:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:1.0:1790779080.919792:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779080.919796:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919802:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919814:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919821:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919826:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919835:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779080.919838:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919843:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919850:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ef240eb6500) 00010000:00010000:1.0:1790779080.919853:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779080.919855:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919861:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919895:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd079 expref: 8 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919907:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387200/0xdc87632656075d49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd079 expref: 7 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779080.919913:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef240eb6c00) 00010000:00010000:1.0:1790779080.919915:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779080.919918:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387200, rc 0) 00000100:00100000:1.0:1790779080.919987:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:14311:x1877767510673536:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 657us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779080.919995:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1790779080.923061:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779080.923174:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673792 00000100:00100000:3.0:1790779080.923188:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673792 00000100:00100000:3.0:1790779080.923268:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790779080.923311:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:14311:x1877767510673792:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779080.923339:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779080.923366:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075d50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd080 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923518:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923539:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923552:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923714:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923739:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923753:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923883:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075d65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923893:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075d65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.923912:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075d65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779080.924403:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1790779080.924565:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924572:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924577:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924580:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779080.924583:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924588:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924597:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef240eb6c00) 00010000:00010000:3.0:1790779080.924599:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779080.924602:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924605:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924615:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924618:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924629:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924632:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779080.924634:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924637:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924700:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ef235cc0500) 00010000:00010000:3.0:1790779080.924704:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779080.924707:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.924713:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.926571:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075d50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd080 expref: 10 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.926599:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1800/0xdc87632656075d65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd080 expref: 9 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779080.926608:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef235cc0100) 00010000:00010000:3.0:1790779080.926611:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779080.926614:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1800, rc 0) 00000100:00100000:3.0:1790779080.930251:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14311:x1877767510673792:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 6929us (7190us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790779080.930302:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790779080.937757:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779080.937896:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510673920 00000100:00100000:1.0:1790779080.937938:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510673920 00000100:00100000:1.0:1790779080.938022:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1790779080.938034:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14311:x1877767510673920:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790779080.938178:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14311:x1877767510673920:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 145us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779080.938186:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1790779081.011000:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.011180:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674048 00000100:00100000:3.0:1790779081.011196:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674048 00000100:00100000:3.0:1790779081.011279:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1790779081.011301:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14317:x1877767510674048:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.011329:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.011357:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd087 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011436:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011503:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011520:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011540:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011547:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011553:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011624:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011657:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011664:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011671:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779081.011677:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011806:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011821:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:3.0:1790779081.011825:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.011831:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011837:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075d7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011858:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011864:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011870:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011875:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779081.011886:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011905:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011913:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef235cc0500) 00010000:00010000:3.0:1790779081.011915:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.011918:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011924:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075d81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011966:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075d73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd087 expref: 10 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011977:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:3.0:1790779081.011979:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.011983:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd087 expref: 10 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.011994:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1e00, rc 0) 00000100:00100000:3.0:1790779081.012074:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14317:x1877767510674048:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 785us (1090us total) trans 0 rc 301/301 00000100:00100000:3.0:1790779081.012082:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1790779081.020794:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.023205:0:15023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674176 00000100:00100000:3.0:1790779081.023228:0:15023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674176 00000100:00100000:3.0:1790779081.023350:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1790779081.023365:0:15023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14317:x1877767510674176:12345-192.168.202.2@tcp:700:lfs.0 00000100:00100000:3.0:1790779081.023589:0:15023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14317:x1877767510674176:12345-192.168.202.2@tcp:700:lfs.0 Request processed in 226us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.023597:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1790779081.026330:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.026430:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674432 00000100:00100000:1.0:1790779081.026463:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674432 00000100:00100000:1.0:1790779081.026525:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790779081.026537:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14317:x1877767510674432:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:1.0:1790779081.026599:0:15015:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779081.026627:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef23cb12e00/0xdc87632656075cb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd002 expref: 9 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.026648:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:1.0:1790779081.026653:0:15015:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779081.026712:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.026726:0:15015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 5 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.026735:0:15015:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.026770:0:15015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 5 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.026807:0:15015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 5 pid: 15014 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.026821:0:15015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:15015:1877767531637504:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790779081.026934:0:15015:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97600 going to sleep for 11 seconds 00000100:00100000:2.0:1790779081.031709:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779081.031805:0:15001:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674560 00000100:00100000:0.0:1790779081.031816:0:15001:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674560 00010000:00010000:0.0:1790779081.031876:0:15001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 6 pid: 15014 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779081.031913:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790779081.031923:0:15001:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2346:x1877767510674560:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779081.031937:0:15001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779081.031944:0:15001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 6 pid: 15014 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.031957:0:15001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 6 pid: 15014 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.031980:0:15001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:0.0:1790779081.031985:0:15001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.031995:0:15001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.032003:0:15001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.032022:0:15001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779081.032080:0:15001:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2346:x1877767510674560:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 158us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779081.032087:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:2.0:1790779081.032236:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790779081.032349:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1000/0xdc87632656075cee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd064 expref: 5 pid: 15014 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.032367:0:15015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:15015:1877767531637504:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790779081.032387:0:15015:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.032395:0:15015:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.032402:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.032425:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.032434:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.032463:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.037717:0:15015:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790779081.037745:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.037757:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.037765:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.037771:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779081.037777:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.037785:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.037801:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef214de9c00) 00010000:00010000:1.0:1790779081.037804:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.037809:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.037815:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779081.037838:0:15015:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9990c11 reply state 000000003ceba396 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.037848:0:15015:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779081.037953:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+10:14317:x1877767510674432:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 11414us (11627us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790779081.037963:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:0.0:1790779081.042721:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.042759:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.042767:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.042774:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1790779081.042779:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.042788:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.042805:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef240eb6500) 00010000:00010000:0.0:1790779081.042808:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779081.042812:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779081.042818:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075d8f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779081.135929:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.136093:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674688 00000100:00100000:1.0:1790779081.136118:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674688 00000100:00100000:1.0:1790779081.136169:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1790779081.136179:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:14325:x1877767510674688:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:1.0:1790779081.136209:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.136245:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd08e expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.136372:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.136392:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.136407:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.136511:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779081.136516:0:15016:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790779081.136571:0:15016:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.136603:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd08e expref: 11 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.136629:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386000/0xdc87632656075d9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd08e expref: 10 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.136639:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:1.0:1790779081.136642:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779081.136646:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386000, rc 0) 00000100:00100000:1.0:1790779081.136729:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+10:14325:x1877767510674688:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 551us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.136737:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1790779081.171984:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.172299:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674816 00000100:00100000:1.0:1790779081.172314:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674816 00000100:00100000:1.0:1790779081.172387:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:1.0:1790779081.172400:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:14326:x1877767510674816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790779081.172423:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.172474:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075da4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd095 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.172550:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075dab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.172565:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.172576:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.172621:0:15015:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779081.172625:0:15015:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790779081.172645:0:15015:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.172682:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386e00/0xdc87632656075da4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd095 expref: 7 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.172700:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386400/0xdc87632656075dab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd095 expref: 6 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.172727:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:1.0:1790779081.172730:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779081.172733:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386400, rc 0) 00000100:00100000:1.0:1790779081.172795:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:14326:x1877767510674816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 397us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.172803:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1790779081.176778:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.177003:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510674944 00000100:00100000:3.0:1790779081.177017:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510674944 00000100:00100000:3.0:1790779081.177086:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1790779081.177095:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:14326:x1877767510674944:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.177116:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.177135:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd09c expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177201:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177217:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177228:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177246:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177253:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177259:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.177433:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075dc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178009:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178019:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.178075:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779081.178079:0:15014:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790779081.178100:0:15014:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178113:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178120:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178130:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178136:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779081.178140:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178148:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.178159:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:3.0:1790779081.178170:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.178176:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180383:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180418:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180426:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180435:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180457:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779081.180464:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180472:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180490:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef235cc0500) 00010000:00010000:3.0:1790779081.180494:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.180499:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180504:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180573:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd09c expref: 8 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180624:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd09c expref: 7 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.180633:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0700) 00010000:00010000:3.0:1790779081.180636:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779081.180639:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1600, rc 0) 00000100:00100000:3.0:1790779081.180760:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+7:14326:x1877767510674944:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 3663us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.180770:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1790779081.187529:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.187607:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510675200 00000100:00100000:3.0:1790779081.187618:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510675200 00000100:00100000:3.0:1790779081.187682:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1790779081.187694:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+7:14326:x1877767510675200:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.187717:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.187739:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075dce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0a3 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.187856:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790779081.187968:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075dce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0a3 expref: 9 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.187985:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:3.0:1790779081.187988:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790779081.187994:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075dce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0a3 expref: 9 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.188037:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1e00, rc 0) 00000100:00100000:3.0:1790779081.188109:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+8:14326:x1877767510675200:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 417us (591us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790779081.188117:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1790779081.196305:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.196599:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510675456 00000100:00100000:3.0:1790779081.196611:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510675456 00000100:00100000:2.0:1790779081.196764:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1790779081.196780:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+8:14326:x1877767510675456:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1790779081.196857:0:15014:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779081.196887:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1600/0xdc87632656075dc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd09c expref: 8 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.196914:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0700) 00010000:00010000:2.0:1790779081.196927:0:15014:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779081.196956:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.197188:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.197201:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779081.197438:0:15014:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008775ff11 reply state 00000000e4f5218a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779081.197531:0:15014:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790779081.197542:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790779081.197664:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+9:14326:x1877767510675456:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 884us (1377us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790779081.197673:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:3.0:1790779081.201867:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.201881:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.201886:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.201891:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779081.201894:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.201899:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.201911:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef2363a8f00) 00010000:00010000:3.0:1790779081.201913:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790779081.201917:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.201921:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075ddc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779081.203638:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.203859:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510675712 00000100:00100000:2.0:1790779081.203872:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510675712 00000100:00100000:2.0:1790779081.203938:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1790779081.203948:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+8:14326:x1877767510675712:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1790779081.204200:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+9:14326:x1877767510675712:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 253us (570us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790779081.204207:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1790779081.210370:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.210495:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510675968 00000100:00100000:1.0:1790779081.210508:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510675968 00000100:00100000:1.0:1790779081.210571:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:1.0:1790779081.210581:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+9:14326:x1877767510675968:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790779081.210608:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.210630:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075de3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0aa expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.210711:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.210727:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.210739:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.210752:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.210760:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.210787:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.210916:0:15015:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790779081.210995:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211004:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211011:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211017:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779081.211022:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211030:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211042:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:1.0:1790779081.211045:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.211050:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211056:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211070:0:15015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211096:0:15015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211103:0:15015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211108:0:15015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779081.211111:0:15015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211118:0:15015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211126:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef240eb6100) 00010000:00010000:1.0:1790779081.211129:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.211132:0:15015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211139:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075df1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211177:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075de3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0aa expref: 11 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211187:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:1.0:1790779081.211190:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779081.211194:0:15015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075de3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0aa expref: 11 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.211213:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387a00, rc 0) 00000100:00100000:1.0:1790779081.211278:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+10:14326:x1877767510675968:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 698us (921us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790779081.211294:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1790779081.213688:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.213786:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510676096 00000100:00100000:3.0:1790779081.213795:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510676096 00000100:00100000:3.0:1790779081.213858:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1790779081.213868:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+10:14326:x1877767510676096:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1790779081.213891:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.213911:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075dff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0b1 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.214166:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.214181:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.214192:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779081.214218:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790779081.214222:0:15016:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790779081.214239:0:15016:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.214263:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075dff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 12 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.214282:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 11 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.214302:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0500) 00010000:00010000:3.0:1790779081.214318:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779081.214322:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0200, rc 0) 00000100:00100000:3.0:1790779081.214500:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15accbd5-659f-4ca9-8da3-b9762ddb0659+11:14326:x1877767510676096:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 633us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.214508:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000040:00080000:2.0:1790779081.229366:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790779081.230106:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.230419:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510676224 00000100:00100000:2.0:1790779081.230433:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510676224 00000100:00100000:2.0:1790779081.231676:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:2.0:1790779081.231692:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+11:14326:x1877767510676224:12345-192.168.202.2@tcp:37:lfs.0 00000100:00100000:3.0:1790779081.236650:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+11:14326:x1877767510676224:12345-192.168.202.2@tcp:37:lfs.0 Request processed in 4948us (6538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.236670:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1790779081.241096:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.241226:0:15018:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510676480 00000100:00100000:1.0:1790779081.241236:0:15018:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510676480 00000100:00100000:1.0:1790779081.241338:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1790779081.241348:0:15018:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef235d68c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+11:14326:x1877767510676480:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1790779081.241607:0:15018:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef235d68c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+12:14326:x1877767510676480:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 260us (521us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790779081.241616:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1790779081.338973:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.339336:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510676608 00000100:00100000:2.0:1790779081.339348:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510676608 00000100:00100000:2.0:1790779081.339415:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1790779081.339429:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+10:14332:x1877767510676608:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790779081.339491:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779081.339515:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656075e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0b8 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.339727:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.339749:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.339766:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.339789:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.339798:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.339809:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340086:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d000/0xdc87632656075e22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340097:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d000/0xdc87632656075e22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340104:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d000/0xdc87632656075e22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779081.340141:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779081.340145:0:15014:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790779081.340188:0:15014:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d000/0xdc87632656075e22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340964:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340976:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340983:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.340989:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779081.340994:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341001:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341014:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:2.0:1790779081.341017:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779081.341022:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341028:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5400/0xdc87632656075e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341042:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341047:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341053:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341068:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235de5000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779081.341071:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341077:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341084:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef2363a8800) 00010000:00010000:2.0:1790779081.341086:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779081.341089:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341095:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de5000/0xdc87632656075e1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341136:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235de4200/0xdc87632656075e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b8 expref: 12 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341149:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d000/0xdc87632656075e22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b8 expref: 11 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.341156:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0500) 00010000:00010000:2.0:1790779081.341158:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790779081.341161:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4d000, rc 0) 00000100:00100000:2.0:1790779081.341241:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+11:14332:x1877767510676608:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1816us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.341250:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1790779081.344708:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.344958:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510676864 00000100:00100000:3.0:1790779081.344970:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510676864 00000100:00100000:3.0:1790779081.345095:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1790779081.345107:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+11:14332:x1877767510676864:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1790779081.345137:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779081.345166:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075e29 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0bf expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.345331:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.345347:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 11 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.345356:0:15016:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.345390:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 11 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.345425:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 11 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.345483:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2333dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531637632:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790779081.345585:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779081.350821:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2333dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531637632:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790779081.350876:0:15016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779081.353193:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.353275:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510676992 00000100:00100000:2.0:1790779081.353310:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510676992 00010000:00010000:2.0:1790779081.353359:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 12 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779081.353400:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1790779081.353410:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+12:2346:x1877767510676992:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779081.353425:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779081.353431:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 12 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.353490:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 12 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.353513:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0200/0xdc87632656075e06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0b1 expref: 12 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.353530:0:15000:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0500) 00010000:00010000:2.0:1790779081.353536:0:15000:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.353547:0:15000:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.353556:0:15000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.353578:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779081.353636:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+11:2346:x1877767510676992:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 227us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.353654:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:1.0:1790779081.353793:0:15016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.353802:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.353832:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.353855:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.353874:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354378:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354390:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354398:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.354409:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790779081.354434:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354482:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354489:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354496:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779081.354501:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354509:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354519:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0500) 00010000:00010000:1.0:1790779081.354523:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779081.354534:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354541:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075e30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779081.354554:0:15016:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008380905d reply state 00000000542807c2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.354563:0:15016:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790779081.354603:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075e29 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 14 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354618:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 13 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.354626:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790779081.354630:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790779081.354632:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387000, rc 0) 00000100:00100000:1.0:1790779081.354697:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+14:14332:x1877767510676864:12345-192.168.202.2@tcp:101:bash.0 Request processed in 9593us (10018us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790779081.354707:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00010000:00010000:2.0:1790779081.361669:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.361689:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.361697:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.361704:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779081.361710:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.361718:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.361734:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ef240eb6100) 00010000:00010000:2.0:1790779081.361737:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779081.361743:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.361749:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387a00/0xdc87632656075e37 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.384744:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.386653:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510677120 00000100:00100000:2.0:1790779081.386669:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510677120 00000100:00100000:2.0:1790779081.386757:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1790779081.386768:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+13:14332:x1877767510677120:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1790779081.386797:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779081.386841:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075e4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0c6 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387618:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387637:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387648:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779081.387709:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790779081.387714:0:15014:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790779081.387734:0:15014:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387745:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387772:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075e4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 15 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387791:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 14 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.387800:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779081.387803:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779081.387807:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c400, rc 0) 00000100:00100000:2.0:1790779081.387942:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+14:14332:x1877767510677120:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1175us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.387966:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1790779081.392657:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.393245:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510677376 00000100:00100000:3.0:1790779081.393259:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510677376 00000100:00100000:3.0:1790779081.393360:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1790779081.393372:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+14:14332:x1877767510677376:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1790779081.393792:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+15:14332:x1877767510677376:12345-192.168.202.2@tcp:35:bash.0 Request processed in 420us (1147us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790779081.393802:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1790779081.484997:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.486755:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510677632 00000100:00100000:1.0:1790779081.486777:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510677632 00000100:00100000:1.0:1790779081.486854:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:1.0:1790779081.486865:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+15:14342:x1877767510677632:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1790779081.487292:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.487314:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0cd expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.487748:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790779081.488771:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0cd expref: 17 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.488800:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef240eb6400) 00010000:00010000:1.0:1790779081.488804:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779081.488810:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0cd expref: 17 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.488831:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236386200, rc 0) 00000100:00100000:1.0:1790779081.489860:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+16:14342:x1877767510677632:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 2990us (4868us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790779081.490218:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:0.0:1790779081.498557:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.499346:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510677888 00000100:00100000:3.0:1790779081.499365:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510677888 00000100:00100000:3.0:1790779081.499491:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1790779081.499503:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+16:14342:x1877767510677888:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1790779081.500022:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+17:14342:x1877767510677888:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 520us (1476us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790779081.500034:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1790779081.564551:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.564711:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510678144 00000100:00100000:2.0:1790779081.564724:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510678144 00000100:00100000:2.0:1790779081.564800:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1790779081.564811:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+17:14345:x1877767510678144:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1790779081.564836:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779081.564857:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075e68 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0d4 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.564966:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c600/0xdc87632656075e6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.564983:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c600/0xdc87632656075e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.564998:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c600/0xdc87632656075e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779081.565014:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779081.565139:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075e68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0d4 expref: 20 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.565686:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c600/0xdc87632656075e6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0d4 expref: 19 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.565698:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779081.565701:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779081.565705:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c600, rc 0) 00000100:00100000:2.0:1790779081.565800:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14345:x1877767510678144:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 991us (1261us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790779081.565808:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1790779081.572475:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779081.572608:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.572668:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510678272 00000100:00100000:3.0:1790779081.572732:0:14999:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510678400 00000100:00100000:3.0:1790779081.572738:0:14999:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510678400 00000100:00100000:1.0:1790779081.572738:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510678272 00000100:00100000:1.0:1790779081.572799:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1790779081.572810:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+20:14345:x1877767510678272:12345-192.168.202.2@tcp:54:lfs.0 00000100:00100000:3.0:1790779081.572838:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1790779081.572846:0:14999:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+20:2346:x1877767510678400:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779081.572875:0:14999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779081.572915:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c600/0xdc87632656075e6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0d4 expref: 20 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.572935:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.572936:0:14999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:3.0:1790779081.572941:0:14999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790779081.572950:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.572960:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.573001:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.573011:0:14999:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:2346:x1877767510678400:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 166us (550us total) trans 0 rc 0/0 00010000:00010000:1.0:1790779081.573016:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.573018:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00010000:00010000:1.0:1790779081.573023:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.573773:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779081.573780:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.573789:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.573801:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790779081.573804:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790779081.573807:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.573813:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386200/0xdc87632656075e7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.573875:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+18:14345:x1877767510678272:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 1065us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.573883:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1790779081.575677:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.575855:0:15018:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510678656 00000100:00100000:2.0:1790779081.575866:0:15018:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510678656 00000100:00100000:2.0:1790779081.576098:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1790779081.576109:0:15018:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+18:14345:x1877767510678656:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1790779081.577176:0:15018:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14345:x1877767510678656:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 1060us (1503us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790779081.577188:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00010000:00010000:2.0:1790779081.680800:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779081.865564:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.865706:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510678912 00000100:00100000:2.0:1790779081.865722:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510678912 00000100:00100000:2.0:1790779081.865794:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1790779081.865805:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14376:x1877767510678912:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1790779081.865830:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779081.865852:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075e84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0db expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.866011:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d200/0xdc87632656075e8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.866155:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d200/0xdc87632656075e8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.866173:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d200/0xdc87632656075e8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779081.866188:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779081.866364:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075e84 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0db expref: 22 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.866389:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d200/0xdc87632656075e8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0db expref: 21 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.866398:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779081.866402:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779081.866405:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4d200, rc 0) 00000100:00100000:2.0:1790779081.866665:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:14376:x1877767510678912:12345-192.168.202.2@tcp:101:cat.0 Request processed in 860us (1115us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790779081.866673:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1790779081.871829:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.872363:0:15001:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510679040 00000100:00100000:1.0:1790779081.872377:0:15001:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510679040 00000100:00100000:1.0:1790779081.872503:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1790779081.872516:0:15001:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:2343:x1877767510679040:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779081.872532:0:15001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779081.872572:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d200/0xdc87632656075e8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0db expref: 21 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.872597:0:15001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790779081.872603:0:15001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779081.872688:0:15001:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+20:2343:x1877767510679040:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 174us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.872696:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1790779081.876801:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.876906:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510679296 00000100:00100000:3.0:1790779081.876919:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510679296 00000100:00100000:3.0:1790779081.876995:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1790779081.877007:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+20:14376:x1877767510679296:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:3.0:1790779081.877676:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:14376:x1877767510679296:12345-192.168.202.2@tcp:35:cat.0 Request processed in 669us (886us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790779081.877684:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1790779081.970847:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.971073:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510679552 00000100:00100000:1.0:1790779081.971084:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510679552 00000100:00100000:1.0:1790779081.971157:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:1.0:1790779081.971167:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:14382:x1877767510679552:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:1.0:1790779081.971199:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.971225:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075e99 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0e2 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971382:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971398:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 22 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971407:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 22 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971417:0:15016:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971510:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 22 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971526:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 22 pid: 15014 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.971543:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531637760:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790779081.971656:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 22 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.971666:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 22 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.971686:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531637888:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790779081.971708:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97840 going to sleep for 11 seconds 00000100:00100000:2.0:1790779081.977223:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.977275:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779081.977366:0:14999:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510679680 00000100:00100000:3.0:1790779081.977376:0:14999:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510679680 00010000:00010000:3.0:1790779081.977416:0:14999:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 23 pid: 15014 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.977472:0:14999:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510679808 00000100:00100000:3.0:1790779081.977476:0:14999:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510679808 00010000:00010000:3.0:1790779081.977487:0:14999:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 24 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779081.977522:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1790779081.977531:0:14999:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef240df7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:2345:x1877767510679680:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779081.977561:0:14999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779081.977568:0:14999:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 24 pid: 15014 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977580:0:14999:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 24 pid: 15014 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977600:0:14999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:3.0:1790779081.977605:0:14999:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977613:0:14999:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977619:0:14999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779081.977684:0:14999:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef240df7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:2345:x1877767510679680:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 154us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.977692:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1790779081.977738:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1790779081.977744:0:14999:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+23:2346:x1877767510679808:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779081.977751:0:14999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779081.977755:0:14999:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 23 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977776:0:14999:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 23 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977786:0:14999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:3.0:1790779081.977790:0:14999:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977797:0:14999:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977806:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.977822:0:14999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779081.977841:0:14999:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+23:2346:x1877767510679808:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 97us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779081.977848:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00010000:00010000:1.0:1790779081.978561:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c400/0xdc87632656075e53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0c6 expref: 22 pid: 15014 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.978582:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531637760:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790779081.978595:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075e3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0bf expref: 21 pid: 15016 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.978603:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531637888:192.168.202.2@tcp:104: 00010000:00010000:1.0:1790779081.978622:0:15016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.978642:0:15016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.978649:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779081.978683:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790779081.978857:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075e99 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e2 expref: 22 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.978871:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387800/0xdc87632656075ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e2 expref: 21 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.978879:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790779081.978882:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790779081.978885:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387800, rc 0) 00000100:00100000:1.0:1790779081.978991:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:14382:x1877767510679552:12345-192.168.202.2@tcp:101:dd.0 Request processed in 7825us (8153us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1790779081.979000:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1790779081.984815:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.984909:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510679936 00000100:00100000:1.0:1790779081.984922:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510679936 00000100:00100000:1.0:1790779081.985003:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1790779081.985015:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:14382:x1877767510679936:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:1.0:1790779081.985050:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779081.985069:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075eae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0e9 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.985122:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.985137:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.985150:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.985294:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075eae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 23 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.985313:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 22 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.985323:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790779081.985326:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779081.985330:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef236387000, rc 0) 00000100:00100000:1.0:1790779081.985402:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+22:14382:x1877767510679936:12345-192.168.202.2@tcp:101:dd.0 Request processed in 389us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779081.985410:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1790779081.990701:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779081.990873:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510680192 00000100:00100000:1.0:1790779081.990885:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510680192 00000100:00100000:1.0:1790779081.991239:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1790779081.991252:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+22:14382:x1877767510680192:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:1.0:1790779081.991596:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.991641:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779081.991654:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790779081.991721:0:15016:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1790779081.991751:0:15016:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d5895021 reply state 00000000b62caa36 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779081.991760:0:15016:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790779081.991867:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14382:x1877767510680192:12345-192.168.202.2@tcp:36:dd.0 Request processed in 617us (1179us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1790779081.991875:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000020:00080000:1.0:1790779081.991881:0:15016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790779081.994516:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.994539:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.994548:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.994554:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779081.994560:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.994591:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.994609:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:3.0:1790779081.994612:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779081.994616:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779081.994622:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387c00/0xdc87632656075ebc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779081.995429:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779081.996347:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510680320 00000100:00100000:2.0:1790779081.996360:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510680320 00000100:00100000:2.0:1790779081.996416:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:2.0:1790779081.996425:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:14382:x1877767510680320:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:2.0:1790779081.996479:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779081.996501:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075ec3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0f0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.996562:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f0 expref: 25 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.996576:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f0 expref: 25 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779081.996606:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779081.996610:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779081.996613:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4da00, rc 0) 00000100:00100000:2.0:1790779081.996667:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14382:x1877767510680320:12345-192.168.202.2@tcp:101:dd.0 Request processed in 243us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779081.996686:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1790779082.014081:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.014925:0:14999:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510680576 00000100:00100000:3.0:1790779082.014938:0:14999:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510680576 00000100:00100000:3.0:1790779082.015033:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1790779082.015044:0:14999:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14382:x1877767510680576:12345-192.168.202.2@tcp:103:dd.0 00010000:00010000:3.0:1790779082.015060:0:14999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779082.015084:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4da00/0xdc87632656075ec3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f0 expref: 25 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.015103:0:14999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:3.0:1790779082.015108:0:14999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779082.015179:0:14999:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:14382:x1877767510680576:12345-192.168.202.2@tcp:103:dd.0 Request processed in 136us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.015187:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00080000:2.0:1790779082.015610:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779082.019717:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.019905:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510680704 00000100:00100000:1.0:1790779082.019918:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510680704 00000100:00100000:1.0:1790779082.019999:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1790779082.020009:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:14382:x1877767510680704:12345-192.168.202.2@tcp:58:dd.0 00010000:00010000:1.0:1790779082.020491:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.020515:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.020530:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779082.022128:0:15014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779082.022825:0:15014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1790779082.023347:0:15014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1790779082.024009:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:14382:x1877767510680704:12345-192.168.202.2@tcp:58:dd.0 Request processed in 3992us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.024022:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1790779082.040800:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.041333:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510680832 00000100:00100000:3.0:1790779082.041345:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510680832 00000100:00100000:3.0:1790779082.041412:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1790779082.041422:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+24:14382:x1877767510680832:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:3.0:1790779082.041480:0:15015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.041501:0:15015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0f7 expref: -99 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.041563:0:15015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.041576:0:15015:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 25 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.041596:0:15015:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.041609:0:15015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 25 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.041625:0:15015:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:3.0:1790779082.041629:0:15015:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790779082.041633:0:15015:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 25 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.041642:0:15015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0e00, rc 0) 00000100:00100000:3.0:1790779082.041714:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14382:x1877767510680832:12345-192.168.202.2@tcp:101:dd.0 Request processed in 293us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.041722:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000040:00080000:2.0:1790779082.252022:0:15046:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790779082.252033:0:15046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779082.252058:0:15046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790779082.252066:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790779082.252208:0:15046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:15046:1877767531638016:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790779082.252369:0:15046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779082.261889:0:15046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:15046:1877767531638016:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790779082.265745:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779082.265922:0:15025:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510680960 00000100:00100000:0.0:1790779082.265933:0:15025:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510680960 00000100:00100000:0.0:1790779082.266008:0:15025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1790779082.266021:0:15025:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510680960:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790779082.266133:0:15025:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510680960:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 114us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779082.266220:0:15025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1790779082.269234:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.269491:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510681088 00000100:00100000:2.0:1790779082.269506:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510681088 00000100:00100000:2.0:1790779082.269593:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1790779082.269605:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510681088:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790779082.269653:0:15014:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790779082.269822:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510681088:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 219us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.269830:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:3.0:1790779082.287993:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.288107:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510681216 00000100:00100000:1.0:1790779082.288118:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510681216 00000100:00100000:1.0:1790779082.288194:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1790779082.288206:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510681216:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790779082.288312:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288332:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288346:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288364:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288370:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288377:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288402:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288432:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288439:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779082.288545:0:15016:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790779082.288551:0:15016:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790779082.288569:0:15016:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288582:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288590:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288597:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288603:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779082.288607:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288614:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288625:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef235cc0100) 00010000:00010000:1.0:1790779082.288628:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779082.288632:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288650:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386a00/0xdc87632656075ed8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288665:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288671:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288676:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288681:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779082.288684:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288689:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288697:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ef240eb6e00) 00010000:00010000:1.0:1790779082.288699:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779082.288702:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288707:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075edf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288723:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288729:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288741:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288746:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1790779082.288749:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288755:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288762:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:1.0:1790779082.288765:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779082.288768:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.288773:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386c00/0xdc87632656075ee6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.288874:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510681216:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 670us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.288882:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:0.0:1790779082.298420:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.298654:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510681472 00000100:00100000:2.0:1790779082.298666:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510681472 00000100:00100000:2.0:1790779082.298745:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1790779082.298756:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+25:14383:x1877767510681472:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779082.298788:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779082.298815:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075eed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd0fe expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.298952:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.298971:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.298983:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779082.298996:0:15014:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779082.299115:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299124:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299130:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299137:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.299155:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299164:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299201:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779082.299204:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779082.299210:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299219:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075ef4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299289:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075eed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0fe expref: 27 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299300:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef235cc0100) 00010000:00010000:2.0:1790779082.299302:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779082.299307:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075eed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0fe expref: 27 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.299317:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4d800, rc 0) 00000100:00100000:2.0:1790779082.299390:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+26:14383:x1877767510681472:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 635us (983us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1790779082.299398:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1790779082.303117:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.303252:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510681600 00000100:00100000:3.0:1790779082.303262:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510681600 00000100:00100000:3.0:1790779082.303339:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1790779082.303349:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+26:14383:x1877767510681600:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790779082.303388:0:15015:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790779082.303700:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+26:14383:x1877767510681600:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 352us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.303708:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:0.0:1790779082.313224:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.313430:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510681856 00000100:00100000:3.0:1790779082.313467:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510681856 00000100:00100000:3.0:1790779082.313536:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1790779082.313547:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+26:14383:x1877767510681856:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.313572:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.313595:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f02 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd105 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790779082.314011:0:15016:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1790779082.314019:0:15016:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1790779082.314039:0:15016:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1790779082.314186:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.314204:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.314217:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.314305:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f02 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd105 expref: 29 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.314352:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd105 expref: 28 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.314362:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0f00) 00010000:00010000:3.0:1790779082.314366:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790779082.314371:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:3.0:1790779082.315194:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+28:14383:x1877767510681856:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1644us (1978us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1790779082.315204:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:0.0:1790779082.321496:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.321658:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510682112 00000100:00100000:2.0:1790779082.321669:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510682112 00000100:00100000:2.0:1790779082.321732:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1790779082.321744:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+28:14383:x1877767510682112:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790779082.321802:0:15014:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779082.321828:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd105 expref: 28 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.321866:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0f00) 00010000:00010000:2.0:1790779082.321877:0:15014:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779082.321898:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.321912:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.321922:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.321978:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.321986:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.321992:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322032:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322039:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322046:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322052:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4d800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.322056:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322071:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322080:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef235cc0500) 00010000:00010000:2.0:1790779082.322082:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779082.322087:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322093:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f17 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322102:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322108:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322114:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322119:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4c000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.322122:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322127:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322133:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd192f66a (ffff9ef2363a8800) 00010000:00010000:2.0:1790779082.322135:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779082.322138:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.322152:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c000/0xdc87632656075f1e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd192f66a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.322226:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+27:14383:x1877767510682112:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 485us (748us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790779082.322233:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1790779082.324501:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.324572:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510682240 00000100:00100000:3.0:1790779082.324581:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510682240 00000100:00100000:3.0:1790779082.324632:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1790779082.324641:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+27:14383:x1877767510682240:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.324666:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.324693:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd10c expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.324730:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075f2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.324742:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.324753:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.324852:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd10c expref: 29 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.324878:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1200/0xdc87632656075f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd10c expref: 28 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.324887:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:3.0:1790779082.324890:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790779082.324893:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1200, rc 0) 00000100:00100000:3.0:1790779082.324946:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+28:14383:x1877767510682240:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 306us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.324954:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1790779082.335149:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.335435:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510682496 00000100:00100000:3.0:1790779082.335571:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510682496 00000100:00100000:3.0:1790779082.335971:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1790779082.335983:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+28:14383:x1877767510682496:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.336073:0:15015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.336090:0:15015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.336102:0:15015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779082.336550:0:15015:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1790779082.336563:0:15015:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 476212120072ns, next at 477212116832ns, rc = 0 00000004:00010000:3.0:1790779082.336613:0:15015:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d4e5e4d6 reply state 0000000074f1e8ae transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.336642:0:15015:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779082.337053:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+30:14383:x1877767510682496:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1069us (1911us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1790779082.337061:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:2.0:1790779082.339887:0:3425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.339957:0:3425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.339965:0:3425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.339971:0:3425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.339976:0:3425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.339985:0:3425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.340000:0:3425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:2.0:1790779082.340003:0:3425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779082.340007:0:3425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.340014:0:3425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0800/0xdc87632656075f33 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15015 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.343697:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.343988:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510682624 00000100:00100000:3.0:1790779082.344000:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510682624 00000100:00100000:3.0:1790779082.344097:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1790779082.344107:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+29:14383:x1877767510682624:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.344131:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.344152:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd113 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.344208:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 30 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.344223:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 30 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.344243:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:3.0:1790779082.344247:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790779082.344251:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a1c00, rc 0) 00000100:00100000:3.0:1790779082.344331:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+30:14383:x1877767510682624:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 225us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.344338:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1790779082.347212:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.347287:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510682752 00000100:00100000:3.0:1790779082.347304:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510682752 00000100:00100000:3.0:1790779082.347380:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1790779082.347389:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2344:x1877767510682752:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790779082.347871:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779082.347901:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2344:x1877767510682752:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 513us (698us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790779082.347909:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1790779082.351656:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.351788:0:15018:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510683008 00000100:00100000:2.0:1790779082.351801:0:15018:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510683008 00000100:00100000:2.0:1790779082.351863:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1790779082.351875:0:15018:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+30:14383:x1877767510683008:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790779082.353320:0:15018:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+31:14383:x1877767510683008:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1439us (1679us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790779082.353333:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1790779082.356333:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.356911:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510683264 00000100:00100000:3.0:1790779082.356922:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510683264 00000100:00100000:3.0:1790779082.356986:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1790779082.356996:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+31:14383:x1877767510683264:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790779082.357191:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+31:14383:x1877767510683264:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 196us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.357200:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1790779082.364897:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.365000:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510683392 00000100:00100000:3.0:1790779082.365011:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510683392 00000100:00100000:3.0:1790779082.365204:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:3.0:1790779082.365216:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+31:14383:x1877767510683392:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.365243:0:15016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779082.365265:0:15016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075f41 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd11a expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.365381:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075f48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.365397:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075f48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.365411:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075f48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779082.365883:0:15016:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790779082.365915:0:15016:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075f48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.365951:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1e00/0xdc87632656075f41 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd11a expref: 33 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.365991:0:15016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075f48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd11a expref: 32 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.366002:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:3.0:1790779082.366005:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790779082.366009:0:15016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef2358a0000, rc 0) 00000100:00100000:3.0:1790779082.366250:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+32:14383:x1877767510683392:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.366260:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:0.0:1790779082.373286:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.373855:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510683520 00000100:00100000:3.0:1790779082.373866:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510683520 00000100:00100000:2.0:1790779082.374027:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1790779082.374040:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2346:x1877767510683520:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779082.374061:0:15799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779082.374154:0:15799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd121 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779082.374257:0:15799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd1eca, blocks: 0x0 00010000:00010000:2.0:1790779082.374291:0:15799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1790779082.374368:0:15799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779082.374383:0:15799:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 7 pid: 15799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.374411:0:15799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 7 pid: 15799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.374430:0:15799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c000, rc 0) 00000100:00100000:2.0:1790779082.374640:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2346:x1877767510683520:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 602us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.374658:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:0.0:1790779082.379830:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.380367:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510683776 00000100:00100000:2.0:1790779082.380379:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510683776 00000100:00100000:2.0:1790779082.380614:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1790779082.380625:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+32:14383:x1877767510683776:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790779082.380772:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+32:14383:x1877767510683776:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 148us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.380780:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1790779082.385137:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.385245:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510683904 00000100:00100000:1.0:1790779082.385255:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510683904 00000100:00100000:1.0:1790779082.385335:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:1.0:1790779082.385345:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+32:14383:x1877767510683904:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790779082.387890:0:14994:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1790779082.387908:0:14994:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1790779082.387945:0:14994:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1790779082.389237:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531638144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790779082.392578:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.392580:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef205bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+15:14383:x1877767510683904:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 7227us (7441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.392598:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1790779082.394221:0:16906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531638144 00000100:00100000:3.0:1790779082.394239:0:16906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531638144 00000100:00080000:1.0:1790779082.394330:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779082.394354:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779082.394366:0:16906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3439:x1877767531638144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790779082.394629:0:16906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790779082.394634:0:16906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1790779082.394636:0:16906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790779082.394638:0:16906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790779082 -> 1790779082 00002000:00010000:2.0:1790779082.394640:0:16906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790779082.394911:0:16906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3439:x1877767531638144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 545us (2341us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790779082.394921:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1790779082.395292:0:3439:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef236812d80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1790779082.395303:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3439:1877767531638144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790779082.399287:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.400212:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684032 00000100:00100000:3.0:1790779082.400227:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684032 00000100:00100000:3.0:1790779082.400314:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1790779082.400347:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2345:x1877767510684032:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790779082.400509:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2345:x1877767510684032:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 166us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.400518:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1790779082.405545:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.405634:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684288 00000100:00100000:2.0:1790779082.405647:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684288 00000100:00100000:2.0:1790779082.405850:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:2.0:1790779082.405865:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+15:14383:x1877767510684288:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790779082.405934:0:15014:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779082.405967:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0000/0xdc87632656075f48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd11a expref: 15 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.406015:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:2.0:1790779082.406020:0:15014:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779082.406055:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.406071:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.406082:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779082.406229:0:15014:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d13bc15f reply state 00000000ba69256f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.406239:0:15014:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790779082.406365:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+16:14383:x1877767510684288:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 503us (830us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790779082.406373:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00010000:00010000:3.0:1790779082.408816:0:3426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.408834:0:3426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.408843:0:3426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.408849:0:3426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4d800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1790779082.408854:0:3426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.408863:0:3426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.408882:0:3426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:3.0:1790779082.408885:0:3426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779082.408902:0:3426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.408908:0:3426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d800/0xdc87632656075f56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.411567:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.411665:0:15796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684416 00000100:00100000:2.0:1790779082.411686:0:15796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684416 00000100:00100000:2.0:1790779082.411753:0:15796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1790779082.411763:0:15796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:14383:x1877767510684416:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779082.411781:0:15796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779082.411807:0:15796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd128 expref: -99 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.411839:0:15796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.411869:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779082.411874:0:15796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779082.411880:0:15796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 8 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.411928:0:15796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.411942:0:15796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.411958:0:15796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15796:1877767531638272:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790779082.412058:0:15796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779082.416369:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.416518:0:15796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15796:1877767531638272:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790779082.416558:0:15796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 8 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.416582:0:15796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4cc00, rc 0) 00000100:00100000:2.0:1790779082.416641:0:15796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+8:14383:x1877767510684416:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4879us (5087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.416650:0:15796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1790779082.416938:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684544 00000100:00100000:3.0:1790779082.416948:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684544 00010000:00010000:3.0:1790779082.416986:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.417049:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1790779082.417059:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+8:2345:x1877767510684544:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779082.417077:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779082.417106:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.417120:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.417146:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008106d067/0xdc87632656075f4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd121 expref: 8 pid: 15799 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.417161:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779082.417165:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779082.417173:0:15000:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 7 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.417184:0:15000:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 7 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.417224:0:15000:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 7 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.417256:0:15000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236810e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:15000:1877767531638400:192.168.202.2@tcp:105: 00000100:00100000:3.0:1790779082.417328:0:15000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779082.422281:0:15000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236810e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:15000:1877767531638400:192.168.202.2@tcp:105: 00010000:00010000:3.0:1790779082.422308:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779082.422425:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2345:x1877767510684544:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 5365us (6068us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.422437:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1790779082.422666:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.422853:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684672 00000100:00100000:2.0:1790779082.422860:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684672 00000100:00100000:2.0:1790779082.422932:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1790779082.422941:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2345:x1877767510684672:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790779082.423141:0:15799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790779082.423145:0:15799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790779082 00002000:00010000:2.0:1790779082.423147:0:15799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790779081 00002000:00010000:2.0:1790779082.423149:0:15799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790779082 -> 1790779082 00002000:00010000:2.0:1790779082.423151:0:15799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790779082.423192:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+8:2345:x1877767510684672:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 252us (526us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790779082.423200:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1790779082.426835:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.426928:0:16906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684800 00000100:00100000:3.0:1790779082.426941:0:16906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684800 00000100:00100000:3.0:1790779082.427057:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1790779082.427068:0:16906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+8:2343:x1877767510684800:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790779082.427116:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.427139:0:16906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 8 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.427150:0:16906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779082.427155:0:16906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790779082.427161:0:16906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.427204:0:16906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 8 pid: 15796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.427245:0:16906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 8 pid: 15796 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.427262:0:16906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16906:1877767531638528:192.168.202.2@tcp:104: 00000100:00100000:3.0:1790779082.427350:0:16906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef235cc3540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779082.429922:0:16906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236810e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16906:1877767531638528:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790779082.429956:0:16906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.431912:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.432098:0:15001:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510684928 00000100:00100000:1.0:1790779082.432109:0:15001:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510684928 00010000:00010000:1.0:1790779082.432160:0:15001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 9 pid: 15796 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.432214:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1790779082.432226:0:15001:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+9:2346:x1877767510684928:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779082.432243:0:15001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779082.432282:0:15001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 9 pid: 15796 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.432297:0:15001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 9 pid: 15796 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.432324:0:15001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f1e0a0/0xdc87632656075f5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd128 expref: 9 pid: 15796 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.432343:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779082.432347:0:15001:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790779082.432354:0:15001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.432365:0:15001:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.432514:0:15001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779082.432586:0:15001:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+8:2346:x1877767510684928:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 362us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.432595:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00010000:00010000:3.0:1790779082.433951:0:16906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.433967:0:16906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.433996:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.434005:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.434014:0:16906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.434049:0:16906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:3.0:1790779082.434053:0:16906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.434062:0:16906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.434079:0:16906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.434087:0:16906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.435291:0:16906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2343:x1877767510684800:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 8201us (8440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.435304:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1790779082.437608:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.437775:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510685184 00000100:00100000:1.0:1790779082.437785:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510685184 00000100:00100000:1.0:1790779082.437861:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:1.0:1790779082.437871:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+15:14383:x1877767510685184:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790779082.437967:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.437986:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 15 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.437995:0:15016:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.438228:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 15 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.438246:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 15 pid: 15014 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.438262:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531638656:192.168.202.2@tcp:104: 00000100:00100000:1.0:1790779082.438355:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef205a97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.441577:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1790779082.441772:0:15000:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510685312 00000100:00100000:0.0:1790779082.441783:0:15000:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510685312 00010000:00010000:0.0:1790779082.441828:0:15000:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 16 pid: 15014 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779082.441842:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531638656:192.168.202.2@tcp:104: 00010000:00010000:3.0:1790779082.441866:0:15016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.441948:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1790779082.441961:0:15000:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+16:2346:x1877767510685312:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779082.441978:0:15000:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779082.441987:0:15000:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 16 pid: 15014 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442021:0:15000:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 16 pid: 15014 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442043:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387000/0xdc87632656075eb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0e9 expref: 16 pid: 15014 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442057:0:15000:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:0.0:1790779082.442063:0:15000:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 15 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442234:0:15000:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442245:0:15000:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442254:0:15000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.442294:0:15000:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779082.442314:0:15016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.442322:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.442358:0:15000:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+15:2346:x1877767510685312:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 400us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779082.442365:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:2.0:1790779082.442668:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.442760:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 15 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.442769:0:15016:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.442802:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 15 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.442815:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 15 pid: 15016 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.442845:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531638784:192.168.202.2@tcp:104: 00000100:00100000:2.0:1790779082.442919:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779082.446498:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.446679:0:15001:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510685440 00000100:00100000:1.0:1790779082.446692:0:15001:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510685440 00010000:00010000:1.0:1790779082.446741:0:15001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 16 pid: 15016 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.446800:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1790779082.446809:0:15001:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+16:2345:x1877767510685440:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779082.446823:0:15001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779082.446830:0:15001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 16 pid: 15016 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.446843:0:15001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 16 pid: 15016 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.446864:0:15001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:1.0:1790779082.446870:0:15001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.446881:0:15001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.446889:0:15001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.446909:0:15001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779082.446969:0:15001:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+16:2345:x1877767510685440:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 161us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.446977:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00010000:00010000:2.0:1790779082.447392:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a1c00/0xdc87632656075f3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd113 expref: 15 pid: 15016 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.447412:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531638784:192.168.202.2@tcp:104: 00010000:00010000:2.0:1790779082.447438:0:15016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.447535:0:15016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.447543:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790779082.447686:0:15016:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1790779082.447809:0:15016:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1790779082.447848:0:15016:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1790779082.447961:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:15016:1877767531638912:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790779082.448332:0:15016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779082.448366:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779082.448583:0:15019:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531638912 00000100:00100000:1.0:1790779082.448591:0:15019:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531638912 00000100:00100000:1.0:1790779082.448635:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779082.448644:0:15019:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15016:x1877767531638912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790779082.448788:0:15019:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15016:x1877767531638912:12345-0@lo:1000:mdt00_002.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.448794:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779082.448850:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236b7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:15016:1877767531638912:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1790779082.448999:0:15016:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1790779082.449051:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236867b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:15016:1877767531639040:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790779082.449215:0:15016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779082.449238:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef227ae0180 going to sleep for 11 seconds 00000100:00100000:0.0:1790779082.449266:0:15020:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639040 00000100:00100000:0.0:1790779082.449270:0:15020:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639040 00000100:00100000:0.0:1790779082.449356:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790779082.449364:0:15020:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15016:x1877767531639040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790779082.449510:0:15020:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15016:x1877767531639040:12345-0@lo:1000:mdt00_002.0 Request processed in 146us (293us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790779082.449517:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779082.449571:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236867b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:15016:1877767531639040:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790779082.449606:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449616:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449624:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449629:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4ce00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.449632:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449638:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449649:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:2.0:1790779082.449651:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779082.449655:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449659:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f72 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449690:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449697:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449702:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449714:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236387e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.449717:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449723:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449732:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779082.449735:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779082.449743:0:15016:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 18 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449754:0:15016:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 18 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449763:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 18 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.449812:0:15016:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef2358a0e00/0xdc87632656075ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd0f7 expref: 18 pid: 15015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779082.449821:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef236864e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531639168:192.168.202.2@tcp:105: 00000100:00100000:2.0:1790779082.449877:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ef23b4b06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779082.452556:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef236864e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:15016:1877767531639168:192.168.202.2@tcp:105: 00010000:00010000:2.0:1790779082.452588:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452615:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236387e00/0xdc87632656075eca lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452651:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452674:0:15016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452833:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452845:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452852:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452859:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452865:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4ca00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.452869:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452878:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452900:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779082.452904:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779082.452908:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452921:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ca00/0xdc87632656075f79 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452933:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452939:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452945:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452951:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef236386800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1790779082.452954:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452962:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452970:0:15016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779082.452972:0:15016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779082.452975:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.452981:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef236386800/0xdc87632656075f6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.453054:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1790779082.453184:0:15017:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510685568 00000100:00100000:3.0:1790779082.453193:0:15017:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510685568 00000100:00100000:3.0:1790779082.453298:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1790779082.453317:0:15017:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2333cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14382:x1877767510685568:12345-192.168.202.2@tcp:49:dd.0 00000100:00100000:3.0:1790779082.453476:0:15017:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2333cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14382:x1877767510685568:12345-192.168.202.2@tcp:49:dd.0 Request processed in 161us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779082.453483:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1790779082.453574:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+18:14383:x1877767510685184:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 15704us (15972us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790779082.453582:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000020:00080000:2.0:1790779082.453591:0:15016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790779082.453735:0:15046:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790779082.453740:0:15046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790779082.453771:0:15046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790779082.453777:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790779082.456387:0:3432:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.456604:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510685696 00000100:00100000:2.0:1790779082.456615:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510685696 00000100:00100000:2.0:1790779082.456840:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1790779082.456851:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+18:14382:x1877767510685696:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:2.0:1790779082.456872:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779082.456901:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f80 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8d695159db7dd12f expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.456941:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656075f87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.456957:0:15014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656075f87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.456970:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656075f87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15014 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.457117:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4ce00/0xdc87632656075f80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd12f expref: 20 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.457136:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4c800/0xdc87632656075f87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x8d695159db7dd12f expref: 19 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.457146:0:15014:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef240eb6a00) 00010000:00010000:2.0:1790779082.457149:0:15014:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790779082.457154:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef235e4c800, rc 0) 00000100:00100000:2.0:1790779082.457237:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14382:x1877767510685696:12345-192.168.202.2@tcp:101:dd.0 Request processed in 389us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.457245:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1790779082.458663:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.458748:0:15018:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510685952 00000100:00100000:2.0:1790779082.458757:0:15018:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510685952 00000100:00100000:2.0:1790779082.458815:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1790779082.458824:0:15018:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+19:14383:x1877767510685952:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790779082.459853:0:15018:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790779082.459888:0:15018:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790779082.459921:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.459941:0:15018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.459954:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.459962:0:15018:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.459968:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.459974:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.460002:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790779082.460284:0:15002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779082.460293:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.460300:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef235e4d400 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:1.0:1790779082.460305:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.460314:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.460327:0:15002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef235cc0300) 00010000:00010000:1.0:1790779082.460329:0:15002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790779082.460335:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.460340:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef235e4d400/0xdc87632656075f8e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779082.460353:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779082.460355:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779082.460356:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779082.460508:0:15018:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:14383:x1877767510685952:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1681us (1905us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790779082.460519:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000020:00080000:2.0:1790779082.460525:0:15018:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790779082.644112:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779082.644185:0:3433:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1790779082.644407:0:15802:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686208 00000100:00100000:3.0:1790779082.644429:0:15803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686080 00000100:00100000:3.0:1790779082.644489:0:15803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686080 00000100:00100000:3.0:1790779082.644590:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1790779082.644603:0:15803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+7:2343:x1877767510686080:12345-192.168.202.2@tcp:4:dd.0 00000100:00100000:2.0:1790779082.644814:0:15802:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686208 00002000:00010000:3.0:1790779082.645029:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abd1eca, atime: 0x6abd1ec9, ctime: 0x6abd1eca, blocks: 0x0 00010000:00010000:3.0:1790779082.645044:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.645077:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1790779082.645084:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779082.645092:0:15803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779082.645110:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779082.699750:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790779082.761800:0:15793:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1790779082.761827:0:15793:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1790779082.762479:0:15803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1790779082.762486:0:15803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1790779082.762507:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.762520:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.762530:0:15803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.762536:0:15803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef2358a1e00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790779082.762541:0:15803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.762550:0:15803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.762570:0:15803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.762596:0:15803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ca4a1ac/0xdc87632656075f95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.762948:0:15803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+6:2343:x1877767510686080:12345-192.168.202.2@tcp:4:dd.0 Request processed in 118340us (118754us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790779082.762964:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1790779082.763015:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1790779082.763038:0:15803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef23674dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2343:x1877767510686208:12345-192.168.202.2@tcp:4:dd.0 00002000:00010000:0.0:1790779082.763088:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6abd1eca, atime: 0x6abd1ec9, ctime: 0x6abd1eca, blocks: 0x2000 00010000:00010000:0.0:1790779082.763095:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.763108:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1790779082.763112:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779082.763118:0:15803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.763129:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779082.766022:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531639424:0@lo:400:kworker.0 00000100:00100000:0.0:1790779082.766406:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531639296:0@lo:400:kworker.0 00000100:00100000:0.0:1790779082.766544:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779082.766602:0:3440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531639808:0@lo:400:kworker.0 00000100:00100000:0.0:1790779082.766635:0:3440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.767067:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779082.767174:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531639552:0@lo:400:kworker.0 00000100:00100000:3.0:1790779082.767254:0:3439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531639680:0@lo:400:kworker.0 00000100:00100000:0.0:1790779082.767571:0:15009:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639296 00000100:00100000:0.0:1790779082.767580:0:15009:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639296 00000100:00100000:0.0:1790779082.767630:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790779082.767639:0:15009:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3440:x1877767531639296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779082.767719:0:15009:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5971fcd9-bd47-4c7f-984b-89395cac9bc1+19:3440:x1877767531639296:12345-0@lo:400:kworker.0 Request processed in 81us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779082.767727:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790779082.767779:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23674d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5971fcd9-bd47-4c7f-984b-89395cac9bc1:3440:1877767531639296:0@lo:400:kworker.0 00000100:00100000:1.0:1790779082.768464:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639808 00000100:00100000:1.0:1790779082.768471:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639808 00000100:00080000:1.0:1790779082.768496:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779082.768529:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779082.768536:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2201ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531639808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779082.768588:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2201ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3440:x1877767531639808:12345-0@lo:400:kworker.0 Request processed in 52us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.768594:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779082.768631:0:3440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3440:1877767531639808:0@lo:400:kworker.0 00000100:00100000:2.0:1790779082.770913:0:15799:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639424 00000100:00100000:2.0:1790779082.770931:0:15799:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639424 00000100:00100000:1.0:1790779082.771236:0:3441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531639936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779082.771342:0:3441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779082.771413:0:15801:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639936 00000100:00100000:1.0:1790779082.771417:0:15801:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639936 00000100:00100000:1.0:1790779082.771486:0:15801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779082.771497:0:15801:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531639936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790779082.771532:0:15801:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1790779082.771583:0:15801:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3441:x1877767531639936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779082.771591:0:15801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779082.771638:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531639936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779082.772434:0:15799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790779082.773892:0:15799:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531639424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779082.774416:0:15799:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3441:x1877767531639424:12345-0@lo:400:kworker.0 Request processed in 1971us (7348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.774427:0:15799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790779082.774486:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790779082.775508:0:3441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef23639aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3441:1877767531639424:0@lo:400:kworker.0 00000100:00100000:2.0:1790779082.775923:0:3439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779082.776236:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779082.776935:0:15016:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639680 00000100:00100000:3.0:1790779082.776946:0:15016:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639680 00000100:00100000:2.0:1790779082.777204:0:15015:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531639552 00000100:00100000:2.0:1790779082.777210:0:15015:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531639552 00000100:00100000:2.0:1790779082.777252:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790779082.777261:0:15015:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531639552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779082.777376:0:15015:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1877767531639552:12345-0@lo:400:kworker.0 Request processed in 116us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.777384:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790779082.777439:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2369b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3442:1877767531639552:0@lo:400:kworker.0 00000100:00080000:3.0:1790779082.777772:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779082.782636:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790779082.782660:0:15016:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531639680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779082.782775:0:15016:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3439:x1877767531639680:12345-0@lo:400:kworker.0 Request processed in 125us (6852us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779082.782782:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790779082.782831:0:3439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3439:1877767531639680:0@lo:400:kworker.0 00000001:00080000:2.0:1790779082.867099:0:15793:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1790779082.867376:0:15803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1790779082.867382:0:15803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1790779082.867402:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.867418:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.867428:0:15803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.867436:0:15803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef23cb12c00 already unused, calling callback (ffffffffc0edbac0) 00010000:00010000:0.0:1790779082.867486:0:15803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.867496:0:15803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.867518:0:15803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779082.867533:0:15803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a0675bc/0xdc87632656075f9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779082.867674:0:15803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef23674dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2343:x1877767510686208:12345-192.168.202.2@tcp:4:dd.0 Request processed in 104637us (223570us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790779082.867685:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00010000:00010000:1.0:1790779083.725907:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779084.109928:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.109974:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.110034:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.110061:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.110078:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.110096:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.110118:0:3434:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1790779084.110144:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686720 00000100:00100000:1.0:1790779084.110154:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686720 00000100:00100000:1.0:1790779084.110208:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686976 00000100:00100000:1.0:1790779084.110211:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686976 00000100:00100000:1.0:1790779084.110225:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686592 00000100:00100000:1.0:1790779084.110228:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686592 00000100:00100000:1.0:1790779084.110239:0:15798:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510687104 00000100:00100000:1.0:1790779084.110241:0:15798:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510687104 00000100:00100000:1.0:1790779084.110266:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1790779084.110278:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2346:x1877767510686720:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790779084.110358:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2346:x1877767510686720:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.110367:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1790779084.110384:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1790779084.110391:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2346:x1877767510686976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790779084.110413:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2346:x1877767510686976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 22us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.110419:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1790779084.110430:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790779084.110436:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2346:x1877767510686592:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790779084.110491:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+5:2346:x1877767510686592:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 55us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.110506:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1790779084.110519:0:15798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1790779084.110525:0:15798:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2346:x1877767510687104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1790779084.110549:0:15798:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15accbd5-659f-4ca9-8da3-b9762ddb0659+5:2346:x1877767510687104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779084.110556:0:15798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1790779084.112106:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686464 00000100:00100000:3.0:1790779084.112118:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686464 00000100:00100000:3.0:1790779084.112249:0:15014:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686848 00000100:00100000:3.0:1790779084.112253:0:15014:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686848 00000100:00100000:3.0:1790779084.112287:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1790779084.112296:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:2346:x1877767510686464:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779084.112361:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d55a8d9-1cd2-4a84-96b1-3c43c9f462bf+21:2346:x1877767510686464:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 66us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.112369:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1790779084.112385:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1790779084.112392:0:15014:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef2365cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2346:x1877767510686848:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779084.112419:0:15014:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef2365cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15accbd5-659f-4ca9-8da3-b9762ddb0659+6:2346:x1877767510686848:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.112425:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1790779084.112464:0:15008:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767510686336 00000100:00100000:3.0:1790779084.112468:0:15008:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767510686336 00000100:00100000:3.0:1790779084.112494:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1790779084.112501:0:15008:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2346:x1877767510686336:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1790779084.112526:0:15008:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36b1f440-03ca-4fd1-afff-83f1743e8b03+13:2346:x1877767510686336:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.112533:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00080000:3.0:1790779084.112560:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779084.112565:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790779084.112568:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1790779084.579639:0:17460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1790779084.756823:0:15003:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779084.811836:0:3442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ef2365cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531640064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779084.811986:0:3442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779084.812156:0:15801:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767531640064 00000100:00100000:3.0:1790779084.812170:0:15801:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767531640064 00000100:00100000:3.0:1790779084.812284:0:15801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779084.812318:0:15801:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef236867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531640064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779084.812370:0:15801:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26325568 pending 0 free 3916005376 avail 3684483072 00000100:00080000:0.0:1790779084.812481:0:15010:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779084.813187:0:15801:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef236867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3442:x1877767531640064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 869us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779084.813199:0:15801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790779084.813279:0:3442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1790779084.813287:0:3442:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef236812d80, transno 8589934595 00000004:00080000:2.0:1790779084.813331:0:3442:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1790779084.813369:0:3442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ef2365cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3442:1877767531640064:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790779085.520511:0:15046:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790779085.520526:0:15046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779085.520557:0:15046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790779085.520573:0:15046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1790779085.771746:0:15002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29821 lines, 29821 kept, 0 dropped, 0 bad.